mpthink 发表于 2011-11-27 20:49:57

采集网址:地址栏无变化如何采集多页

求助,小弟目前想采集如下网址的网址,但是这个页面不能像其他多页网址,可以修改多页地址形式进行采集,当点击“next>”的时候,地址栏是不变化的,不知道如何设置地址栏格式,不知道有没有遇到次问题的大侠~
非常感谢:

http://www.ncbi.nlm.nih.gov/sites/entrez?db=pubmed&term=%22Nature%22%5Bjour%5D

当点击下一页后link一直是:http://www.ncbi.nlm.nih.gov/sites/entrez

真不知道如何处理。

303718 发表于 2011-11-28 16:09:50

这种情况可以尝试使用POST采集

mpthink 发表于 2011-11-28 21:06:32

303718 发表于 2011-11-28 16:09 static/image/common/back.gif
这种情况可以尝试使用POST采集

谢谢元老的回复,小弟已经用post采集,但是发现一个新的问题,通过CurrPage=1/2/3等可以到分页上去而且用浏览器打开正常,所以我把这里修改为CurrPage=[分页],但是用火车头采集的链接却不对,感觉火车头并没有去访问该url,而是访问另外的url,跟通过浏览器访问的不一样,请问这是为什么?


下面是post的url:
http://www.ncbi.nlm.nih.gov/sites/entrez?EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.SearchResourceList=pubmed&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.Term=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.FeedLimit=15&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.FeedName=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.CurrDb=pubmed&EntrezSystem2.PEntrez.Pubmed.Entrez_PageController.PreviousPageName=results&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sSort=none&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FFormat=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FSort=&email_format=docsum&email_sort=&email_count=20&email_start=1&email_address=&email_add_text=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FileFormat=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastPresentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Presentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.PageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastPageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Sort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FileSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Format=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastFormat=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.cPage=1&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.CurrPage=(*)&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_ResultsController.ResultCount=95675&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_ResultsController.RunLastQuery=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.cPage=1&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation2=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPageSize2=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sSort2=none&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FFormat2=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FSort2=&email_format2=docsum&email_sort2=&email_count2=20&email_start2=1&email_address2=&email_add_text2=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Filters.CurrFilter=all&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Filters.LastFilter=all&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.RelatedDataLinks.rdDatabase=rddbto&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.RelatedDataLinks.DbName=pubmed&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.Discovery_SearchDetails.SearchDetailsTerm=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.HistoryDisplay.Cmd=PageChanged&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailReport=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailFormat=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailCount=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailStart=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.Email=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailText=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailQueryKey=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.QueryDescription=&EntrezSystem2.PEntrez.DbConnector.Db=pubmed&EntrezSystem2.PEntrez.DbConnector.LastDb=pubmed&EntrezSystem2.PEntrez.DbConnector.Term=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.DbConnector.LastTabCmd=&EntrezSystem2.PEntrez.DbConnector.LastQueryKey=1&EntrezSystem2.PEntrez.DbConnector.IdsFromResult=&EntrezSystem2.PEntrez.DbConnector.LastIdsFromResult=&EntrezSystem2.PEntrez.DbConnector.LinkName=&EntrezSystem2.PEntrez.DbConnector.LinkReadableName=&EntrezSystem2.PEntrez.DbConnector.LinkSrcDb=&EntrezSystem2.PEntrez.DbConnector.Cmd=PageChanged&EntrezSystem2.PEntrez.DbConnector.TabCmd=&EntrezSystem2.PEntrez.DbConnector.QueryKey=&p%24a=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.Page&p%24l=EntrezSystem2&p%24st=entrez
页: [1]
查看完整版本: 采集网址:地址栏无变化如何采集多页