{"id":2359,"date":"2015-02-26T01:24:50","date_gmt":"2015-02-25T21:24:50","guid":{"rendered":"https:\/\/rakhesh.com\/?p=2359"},"modified":"2015-02-26T02:00:29","modified_gmt":"2015-02-25T22:00:29","slug":"powershell-as-wget-curl","status":"publish","type":"post","link":"https:\/\/rakhesh.com\/powershell\/powershell-as-wget-curl\/","title":{"rendered":"PowerShell as wget\/ curl"},"content":{"rendered":"

I needed to download OneGet<\/code> for the previous post<\/a>. I had the URL, but rather than open a browser as I would usually do I used PowerShell to download the file:<\/p>\n

PS> Invoke-WebRequest http:\/\/oneget.org\/oneget.zip -OutFile oneget.zip<\/pre>\n
Nifty, eh! If you omit the -OutFile<\/code> you get the headers and such:<\/p>\n
PS> Invoke-WebRequest http:\/\/oneget.org\/oneget.zip\r\n\r\n\r\nStatusCode        : 200\r\nStatusDescription : OK\r\nContent           : {80, 75, 3, 4...}\r\nRawContent        : HTTP\/1.1 200 OK\r\n                    Content-MD5: \/bez4IkFAORz1WWm80bHnw==\r\n                    x-ms-request-id: d6df72e2-0001-0017-0896-11458a000000\r\n                    x-ms-version: 2009-09-19\r\n                    x-ms-lease-status: unlocked\r\n                    x-ms-blob-type: BlockBlob\r\n                    Content...\r\nHeaders           : {[Content-MD5, \/bez4IkFAORz1WWm80bHnw==], [x-ms-request-id, d6df72e2-0001-0017-0896-11458a000000],\r\n                    [x-ms-version, 2009-09-19], [x-ms-lease-status, unlocked]...}\r\nRawContentLength  : 906946\r\n\r\n\r\n\r\nPS> Invoke-WebRequest http:\/\/oneget.org\/oneget.zip | select -ExpandProperty Headers\r\n\r\nKey                                                         Value\r\n---                                                         -----\r\nContent-MD5                                                 \/bez4IkFAORz1WWm80bHnw==\r\nx-ms-request-id                                             d6dfadf7-0001-0017-3e96-11458a000000\r\nx-ms-version                                                2009-09-19\r\nx-ms-lease-status                                           unlocked\r\nx-ms-blob-type                                              BlockBlob\r\nContent-Length                                              906946\r\nContent-Type                                                application\/octet-stream\r\nDate                                                        Wed, 25 Feb 2015 21:07:42 GMT\r\nETag                                                        0x8D1CE392F8BDAF4\r\nLast-Modified                                               Fri, 14 Nov 2014 15:45:44 GMT\r\nServer                                                      Windows-Azure-Blob\/1.0 Microsoft-HTTPAPI\/2.0<\/pre>\n
Lastly, just for kicks, to get all elements of a certain tag from a website:<\/p>\n
PS> (Invoke-WebRequest https:\/\/rakhesh.com).AllElements | ?{ $_.tagname -eq \"h2\" } | ft outerText\r\n\r\nouterText\r\n---------\r\nPowerShell as wget\/ curl\r\nNotes of PowerShell DSC course, OneGet & Chocolatey\r\nDesired State Configuration (DSC)\r\nOneGet and friends\r\nNotes on using Git from behind a firewall, tunneling SSH through a proxy, Git credential helpers, and so on \u2026\r\nBatch file to add BUILTIN\\Administrators group to a folder of roaming profiles\r\nTo view a file or folder owner use dir \/q\r\nBeware of takeown and recursively operating\r\nNew features in BlackBerry OS 10.3.1 (picture heavy)\r\nAD Domain Password policies\r\nUsing Git and Dropbox (along with GitHub but working tree in Dropbox)\r\nSetting it up\r\nChanging things\r\nChanging things (part 2)\r\nWrapping up\r\nRoaming profile permissions and versions\r\nHow to move\/ separate the .git folder out of your working tree\r\nUsing Git and Dropbox (along with GitHub)\r\nThoughts on BBC One\u2019s \u201cThe Missing\u201d\r\nSetting up a test lab with Azure (part 1)\r\nStep 1: Create an affinity group\r\nStep 2: Set up the network\r\nStep 3: Create a storage account\r\nStep 4: Create a VM\r\nStep 5: Set up self-signed certificate for PowerShell remoting\r\nStep 6: Create a domain and promote this machine to DC\r\nReplicate with repadmin\r\nAuthorizing a DHCP server in a Child Domain requires Enterprise Admin rights (or a delegation)\r\nWindows 10 Cortana is not available if the region is not US\r\nWindows 10 activation\r\nNotes on Dynamic DNS updates, DNS Scavenging, etc.\r\nScavenging\r\nQuickly rename a bunch of files via PowerShell<\/pre>\n
Got to love it when you can do such cool things with Windows\/ PowerShell so easily! A few years ago I could have barely imagined such a thing would be possible on Windows.<\/p>\n
Update<\/strong>: While I am at it, here’s how you can quickly download a bunch of files from a website. In this case I want to download all mp3 files from a music website (for example purposes!). Through trial and error I know the links have the text “download” in them, so I can filter for such links and then download each of these to an appropriate file:<\/p>\n
(Invoke-WebRequest http:\/\/downloadming.nu\/badlapur-2015-mp3-songs).Links | ?{ $_.outerText -eq \"download\" } | select href | %{ Invoke-WebRequest $_.href -OutFile $(Split-Path -Leaf $_.href) }<\/pre>\n
Or a variant:<\/p>\n
# I expand the \"href\" hashtable beforehand in this case\r\n(Invoke-WebRequest http:\/\/downloadming.nu\/badlapur-2015-mp3-songs).Links | ?{ $_.outerText -eq \"download\" } | select -ExpandProperty href | %{ Invoke-WebRequest $_ -OutFile $(Split-Path -Leaf $_) }<\/pre>\n
If you use a different site you’ll have to modify the filters accordingly, but it’s pretty straight-forward …<\/p>\n","protected":false},"excerpt":{"rendered":"
I needed to download OneGet for the previous post. I had the URL, but rather than open a browser as I would usually do I used PowerShell to download the file: PS> Invoke-WebRequest http:\/\/oneget.org\/oneget.zip -OutFile oneget.zip Nifty, eh! If you omit the -OutFile you get the headers and such: PS> Invoke-WebRequest http:\/\/oneget.org\/oneget.zip StatusCode : 200 … Continue reading PowerShell as wget\/ curl<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[2],"tags":[476,126,475],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts\/2359"}],"collection":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/comments?post=2359"}],"version-history":[{"count":0,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts\/2359\/revisions"}],"wp:attachment":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/media?parent=2359"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/categories?post=2359"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/tags?post=2359"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}