采集网址：地址栏无变化如何采集多页

mpthink

求助，小弟目前想采集如下网址的网址，但是这个页面不能像其他多页网址，可以修改多页地址形式进行采集，当点击“next>”的时候，地址栏是不变化的，不知道如何设置地址栏格式，不知道有没有遇到次问题的大侠~
非常感谢：

http://www.ncbi.nlm.nih.gov/sites/entrez?db=pubmed&term=%22Nature%22%5Bjour%5D

当点击下一页后link一直是：http://www.ncbi.nlm.nih.gov/sites/entrez

真不知道如何处理。

303718

这种情况可以尝试使用POST采集

mpthink

303718 发表于 2011-11-28 16:09
这种情况可以尝试使用POST采集

谢谢元老的回复，小弟已经用post采集，但是发现一个新的问题，通过CurrPage=1/2/3等可以到分页上去而且用浏览器打开正常，所以我把这里修改为CurrPage=[分页]，但是用火车头采集的链接却不对，感觉火车头并没有去访问该url，而是访问另外的url，跟通过浏览器访问的不一样，请问这是为什么？


下面是post的url：
http://www.ncbi.nlm.nih.gov/sites/entrez?EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.SearchResourceList=pubmed&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.Term=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.FeedLimit=15&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.FeedName=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_SearchBar.CurrDb=pubmed&EntrezSystem2.PEntrez.Pubmed.Entrez_PageController.PreviousPageName=results&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sSort=none&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FFormat=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FSort=&email_format=docsum&email_sort=&email_count=20&email_start=1&email_address=&email_add_text=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FileFormat=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastPresentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Presentation=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.PageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastPageSize=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Sort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FileSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.Format=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.LastFormat=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.cPage=1&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.CurrPage=(*)&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_ResultsController.ResultCount=95675&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_ResultsController.RunLastQuery=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.cPage=1&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation2=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPageSize2=20&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sSort2=none&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FFormat2=docsum&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.FSort2=&email_format2=docsum&email_sort2=&email_count2=20&email_start2=1&email_address2=&email_add_text2=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Filters.CurrFilter=all&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Filters.LastFilter=all&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.RelatedDataLinks.rdDatabase=rddbto&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.RelatedDataLinks.DbName=pubmed&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_MultiItemSupl.Discovery_SearchDetails.SearchDetailsTerm=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.HistoryDisplay.Cmd=PageChanged&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailReport=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailFormat=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailCount=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailStart=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailSort=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.Email=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailText=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.EmailQueryKey=&EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.EmailTab.QueryDescription=&EntrezSystem2.PEntrez.DbConnector.Db=pubmed&EntrezSystem2.PEntrez.DbConnector.LastDb=pubmed&EntrezSystem2.PEntrez.DbConnector.Term=%22Nature%22%5Bjour%5D&EntrezSystem2.PEntrez.DbConnector.LastTabCmd=&EntrezSystem2.PEntrez.DbConnector.LastQueryKey=1&EntrezSystem2.PEntrez.DbConnector.IdsFromResult=&EntrezSystem2.PEntrez.DbConnector.LastIdsFromResult=&EntrezSystem2.PEntrez.DbConnector.LinkName=&EntrezSystem2.PEntrez.DbConnector.LinkReadableName=&EntrezSystem2.PEntrez.DbConnector.LinkSrcDb=&EntrezSystem2.PEntrez.DbConnector.Cmd=PageChanged&EntrezSystem2.PEntrez.DbConnector.TabCmd=&EntrezSystem2.PEntrez.DbConnector.QueryKey=&p%24a=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Entrez_Pager.Page&p%24l=EntrezSystem2&p%24st=entrez