打开APP
userphoto
未登录

开通VIP，畅享免费电子书等14项超值服

开通VIP

首页

好书

留言交流

下载APP

联系客服
curl 命令详解
userphoto 关注

curl 命令详解

命令事例

  • 发送POST请求：
    • 如果传输文件：curl -F "blob=@tmp.txt;type=text/plain" localhost:8080/request_body
    • 普通post请求：curl -d "method=searchone&module=seller&user_name=wb-liqiu&nickname=dd" -H"Host:fmp.view.lz.taobao.com" "10.235.160.141:8082/api.php"
  • 模拟登录，传输cookie和参数：
    • 登录：curl -c ./cookie_c.txt -F log=aaaa -F pwd=****** http://blog.51yip.com/wp-login.php
    • 登录之后，可以使用-b参数，携带cookie -b ./cookie_c.txt http://www.***.com
  • 伪造来源地址，有的网站会判断，请求来源地址
    • curl -e http://localhost http://www.sina.com.cn
  • 伪造cookie，防止302跳转页面不能下载
    • wget --cookies=on --load-cookies=cookie.txt －-keep-session-cookies --save-cookies=cookie.txt http://detail.tmall.com/item.htm?id=25139372969
  • 使用proxy缓存
    • curl -L -x127.0.0.1:13128 http://detail.tmall.com/item.htm?id=25823396605

命令事例详解

    一、查看网页源码

    直接在curl命令后加上网址，就可以看到网页源码。我们以网址www.sina.com为例（选择该网址，主要因为它的网页代码较短）

curl www.baidu.com

    如果要把这个网页保存下来，可以使用-o参数，这就相当于使用wget命令了。

curl -o [文件名] www.baidu.com

    二、自动跳转 有的网址是自动跳转的。使用-L参数，curl就会跳转到新的网址。curl -L http://item.taobao.com/item.htm?id=25823396605 键入上面的命令，结果就自动跳转为http://detail.tmall.com/item.htm?id=25823396605

    三、显示头信息 -i 参数可以显示http response的头信息，连同网页代码一起。（-I 参数则是只显示http response的头信息。）

curl -i www.baidu.com
 HTTP/1.1 200 OKDate: Fri, 28 Feb 2014 05:39:57 GMTContent-Type: text/htmlTransfer-Encoding: chunkedConnection: Keep-AliveVary: Accept-EncodingSet-Cookie: BAIDUID=0F251A658E427EBB7CBEB0C3F4A70FAE:FG=1; expires=Thu, 31-Dec-37 23:55:55 GMT; max-age=2147483647; path=/; domain=.baidu.comSet-Cookie: BDSVRTM=0; path=/Set-Cookie: H_PS_PSSID=4104_5231_1445_5139_5225_5378_5368_4261_4760_5400; path=/; domain=.baidu.comP3P: CP=" OTI DSP COR IVA OUR IND COM "Expires: Fri, 28 Feb 2014 05:39:45 GMTCache-Control: privateServer: BWS/1.1BDPAGETYPE: 1BDQID: 0xc3b306dca955703dBDUSERID: 0<!DOCTYPE html>.....

    四、显示通信过程 -v 参数可以显示一次http通信的整个过程，包括端口连接和http request头信息。命令：curl -v www.baidu.com

* About to connect() to www.baidu.com port 80*   Trying 115.239.210.26... connected* Connected to www.baidu.com (115.239.210.26) port 80> GET / HTTP/1.1> User-Agent: curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5> Host: www.baidu.com> Accept: */*> < HTTP/1.1 200 OK< Date: Fri, 28 Feb 2014 05:42:37 GMT< Content-Type: text/html< Transfer-Encoding: chunked< Connection: Keep-Alive< Vary: Accept-Encoding< Set-Cookie: BAIDUID=442AD49501EF253AE71F2BAF3E0181FB:FG=1; expires=Thu, 31-Dec-37 23:55:55 GMT; max-age=2147483647; path=/; domain=.baidu.com< Set-Cookie: BDSVRTM=0; path=/< Set-Cookie: H_PS_PSSID=5228_1461_5187_5138_5225_5379_5368_4261_4760_5401_5286; path=/; domain=.baidu.com< P3P: CP=" OTI DSP COR IVA OUR IND COM "< Expires: Fri, 28 Feb 2014 05:41:43 GMT< Cache-Control: private< Server: BWS/1.1< BDPAGETYPE: 1< BDQID: 0x906950d16fb1e95d< BDUSERID: 0  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current                                 Dload  Upload   Total   Spent    Left  Spee<!DOCTYPE html><!--STATUS OK--><html><head><meta http-equiv="content-type" content="text/html;charset=utf-8"><meta http-equiv="X-UA-Compatible" content="IE=Edge"><link rel="dns-

    如果你觉得上面的信息还不够，那么下面的命令可以查看更详细的通信过程: curl --trace output.txt www.baidu.com 或者 curl --trace-ascii output.txt www.baidu.com 运行后，请打开output.txt文件查看。

    当然也有更狠的，查看页面跳转过程：curl -L -I --trace log http://item.taobao.com/item.htm?id=25823396605

HTTP/1.1 301 Moved PermanentlyServer: TengineDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/html;charset=GBKContent-Length: 0Connection: closeP3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Content-Language: zh-CNAccept-Ranges: bytesX-Varnish: 1206961665Via: 1.1 varnishlocation: http://detail.tmall.com/item.htm?id=25823396605&X-Cache: MISSCache-Control: max-age=3HTTP/1.1 302 FoundServer: TengineDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: keep-aliveat_bucketid: sbucket_-1X-Bucket-Id: -1Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1Cache-Control: HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeSet-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Location: http://pass.tmall.com/add?_tb_token_=ktbzEwzFR6qy&cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9&t=d768c73859b40e10ef81f7abd0824704&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1&pacc=A_12nKe89qHIcAyauBtovg==&opi=110.75.118.230&tmsc=1393568161483632HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeP3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Set-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.tmall.com;Path=/Set-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.tmall.com;Path=/Set-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.tmall.com;Path=/Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=1HTTP/1.1 302 FoundServer: TengineDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: keep-aliveat_bucketid: sbucket_-1X-Bucket-Id: -1Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2Cache-Control: HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeSet-Cookie: _tb_token_=GgU93fEjKGT4;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Location: http://pass.tmall.com/add?_tb_token_=GgU93fEjKGT4&cookie2=ef3c440d74ff391de6b560da4ef8a5c9&t=187a71d8df58caac2c4e08d40245c31f&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2&pacc=Vo8f-VlYEYPJ6WE3iTX96Q==&opi=110.75.118.230&tmsc=1393568161501736HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeP3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Set-Cookie: _tb_token_=GgU93fEjKGT4;domain=.tmall.com;Path=/Set-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.tmall.com;Path=/Set-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.tmall.com;Path=/Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=2HTTP/1.1 302 FoundServer: TengineDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: keep-aliveat_bucketid: sbucket_-1X-Bucket-Id: -1Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3Cache-Control: HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeSet-Cookie: _tb_token_=Uta86PoG6cWC;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.taobao.com;Path=/;HttpOnlySet-Cookie: t=618388c77aff03aec08309747a82f440;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Location: http://pass.tmall.com/add?_tb_token_=Uta86PoG6cWC&cookie2=cd06dba05f2bf1124200861d0b8a151b&t=618388c77aff03aec08309747a82f440&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3&pacc=RptvnJCXDG4WtvFa0JIqoQ==&opi=110.75.118.230&tmsc=1393568161510003HTTP/1.1 302 FoundDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/htmlContent-Length: 260Connection: closeP3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'Set-Cookie: _tb_token_=Uta86PoG6cWC;domain=.tmall.com;Path=/Set-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.tmall.com;Path=/Set-Cookie: t=618388c77aff03aec08309747a82f440;domain=.tmall.com;Path=/Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=3HTTP/1.1 200 OKServer: TengineDate: Fri, 28 Feb 2014 06:16:01 GMTContent-Type: text/html;charset=GBKConnection: keep-aliveVary: Accept-Encodingat_bucketid: sbucket_-1X-Bucket-Id: -1Cache-Control: max-age=1At_Autype: 4_103979994At_Cat: item_50018599X-Category: /cat/50008090At_Nick: %E8%B6%8A%E5%BA%A6%E6%95%B0%E7%A0%81%E4%B8%93%E8%90%A5%E5%BA%97At_Itemid: 25823396605At_Isb: 1At_Pgty: 2At_Cat: 50018599At_Brid: 272676782At_Prid: 221236332At_Autype: 0_103979994At_Auid: 25823396605Content-Language: zh-CNX-Cache: MISS TCP_MISS dirn:-2:-2Via: wagbridge010207087016.cm3:8888

    五、发送表单信息 发送表单信息有GET和POST两种方法。GET方法相对简单，只要把数据附在网址后面就行: curl baidu.com/form.cgi?data=xxx

    POST方法必须把数据和网址分开，例如：curl -d "method=searchone&module=seller&user_name=wb-liqiu&nickname=dd" -H"Host:fmp.view.lz.taobao.com" "10.235.160.141:8082/api.php"

    六、文件上传 假定文件上传的表单你可以用curl这样上传文件，命令：curl --form upload=@localfilename --form press=OK http://www.baidu.com

    七、Referer字段 有时你需要在http request头信息中，提供一个referer字段，表示你是从哪里跳转过来的: curl --referer http://www.baidu.com http://www.baidu.com

    八、User Agent字段 这个字段是用来表示客户端的设备信息。服务器有时会根据这个字段，针对不同设备，返回不同格式的网页，比如手机版和桌面版。 iPhone4的User Agent是: “Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_0 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8A293 Safari/6531.22.7”。curl可以这样模拟： curl --user-agent "[User Agent]" [URL]

    九、cookie 使用--cookie参数，可以让curl发送cookie。curl --cookie "name=xxx" www.baidu.com 至于具体的cookie的值，可以从http response头信息的Set-Cookie字段中得到。也可以例如：curl -c ./cookie.txt http://www.baidu.com

    十、增加头信息 有时需要在http request之中，自行增加一个头信息。--header参数就可以起到这个作用。curl --header "xxx: xxxxxx" http://baidu.com

    十一、HTTP认证 有些网域需要HTTP认证，这时curl需要用到--user参数：curl --user name:password baidu.com

<html><meta http-equiv="refresh" content="0;url=http://www.baidu.com/"></html>

    十二、设置代理缓存 -x<ip:port>

curl -L -x127.0.0.1:13128 http://detail.tmall.com/item.htm?id=25823396605

 

本站仅提供存储服务，所有内容均由用户发布，如发现有害或侵权内容，请点击举报。
打开APP，阅读全文并永久保存 查看更多类似文章
猜你喜欢
类似文章
【热】打开小程序，算一算2024你的财运
R语言爬虫之
LoadRunner脚本解释分析
如何最简单的设置手机店铺优惠券？
购书商城
curl获取网站的http的状态码
集分宝淘金币红包签到大全
更多类似文章 >>
生活服务
热点新闻
留言交流
回顶部
联系我们
分享 收藏 导长图 关注 下载文章
绑定账号成功
后续可登录账号畅享VIP特权！
如果VIP功能使用有故障，
可点击这里联系客服！

联系客服