powershell網絡蜘蛛解決亂碼問題

抓?。ㄅ廊。┚W上信息的腳本程序，俗稱網絡蜘蛛。
powershell中自帶了這樣的兩個命令，【Invoke-WebRequest】和【Invoke-RestMethod】，但這兩個命令有時候會亂碼。

現在轉帖分享， 某個【歪果仁】寫的腳本。來源于 墻外出處： https://gist.github.com/angel-vladov/9482676

核心代碼

1. function Read-HtmlPage {
2. param ([Parameter(Mandatory=$true, Position=0, ValueFromPipeline=$true)][String] $Uri)
3.  
4. # Invoke-WebRequest and Invoke-RestMethod can't work properly with UTF-8 Response so we need to do things this way.
5. [Net.HttpWebRequest]$WebRequest = [Net.WebRequest]::Create($Uri)
6. [Net.HttpWebResponse]$WebResponse = $WebRequest.GetResponse()
7. $Reader = New-Object IO.StreamReader($WebResponse.GetResponseStream())
8. $Response = $Reader.ReadToEnd()
9. $Reader.Close()
10.  
11. # Create the document class
12. [mshtml.HTMLDocumentClass] $Doc = New-Object -com "HTMLFILE"
13. $Doc.IHTMLDocument2_write($Response)
14.  
15. # Returns a HTMLDocumentClass instance just like Invoke-WebRequest ParsedHtml
16. $Doc
17.  
18. #powershell 傳教士 轉帖并修改的文章 2016-01-01, 允許再次轉載，但必須保留名字和出處，否則追究法律責任
19.  
20. }

原文函數

1. function Read-HtmlPage {
2. param ([Parameter(Mandatory=$true, Position=0, ValueFromPipeline=$true)][String] $Uri)
3.  
4. # Invoke-WebRequest and Invoke-RestMethod can't work properly with UTF-8 Response so we need to do things this way.
5. [Net.HttpWebRequest]$WebRequest = [Net.WebRequest]::Create($Uri)
6. [Net.HttpWebResponse]$WebResponse = $WebRequest.GetResponse()
7. $Reader = New-Object IO.StreamReader($WebResponse.GetResponseStream())
8. $Response = $Reader.ReadToEnd()
9. $Reader.Close()
10.  
11. # Create the document class
12. [mshtml.HTMLDocumentClass] $Doc = New-Object -com "HTMLFILE"
13. $Doc.IHTMLDocument2_write($Response)
14.  
15. # Returns a HTMLDocumentClass instance just like Invoke-WebRequest ParsedHtml
16. $Doc
17. }

PowerShell function you can use for reading UTF8 encoded HTML pages content. The built in Invoke-WebRequest and Invoke-RestMethod fail miserably.