jssj2010 发表于 2010-6-22 16:39:28

各位高手帮帮忙，这种网站如何采集？

本帖最后由 jssj2010 于 2010-6-22 16:46 编辑

http://www.zjhotels.org/News/NewsList.aspx?id=1
这个网站，文章列表翻页的话URL是固定的，怎么才能采集到第2.3.4......页的文章？
我很菜，别骂哈。是真的不会。
麻烦说的具体一些。

jzq999888 发表于 2010-6-22 17:08:20

这样是不是的

jssj2010 发表于 2010-6-22 17:32:02

回复 2# jzq999888


    不是这样的，你采集的是一个国内新闻，一个国际新闻。 是两个栏目下的。
    列表页面的URL是固定的，没有变量

jssj2010 发表于 2010-6-22 17:34:52


注意看后两幅图的URL是不变的    但是前两副图下面的翻页则是已经变了的

月白 发表于 2010-6-23 13:49:54

POST方式采集__EVENTTARGET=dtgChinaNews%24ctl24%24ctl0[分页]&__EVENTARGUMENT=&__VIEWSTATE=%2FwEPDwUKMTg1MDAyNjA0Mw9kFgICAQ9kFgYCAQ9kFhgCAQ8WAh4FY2xhc3MFBGJhcjFkAgMPFgIfAAUEYmFyMWQCBQ8WAh8ABQRiYXIyZAIHDxYCHwAFBGJhcjFkAgkPFgIfAAUEYmFyMWQCCw8WAh8ABQRiYXIxZAINDxYCHwAFBGJhcjFkAg8PFgIfAAUEYmFyMWQCEQ8WAh8ABQRiYXIxZAITDxYCHwAFBGJhcjFkAhUPFgIfAAUEYmFyMWQCFw8WAh8ABQRiYXIxZAIFDxYCHgNzcmMFHC4uL2ltYWdlcy9OZXdzL2hvbWVuZXdzMS5naWZkAgcPPCsACwEADxYIHghEYXRhS2V5cxYAHgtfIUl0ZW1Db3VudAIUHglQYWdlQ291bnQCxAIeFV8hRGF0YVNvdXJjZUl0ZW1Db3VudALNMmQWAmYPZBYoAgIPZBYCZg8PFgIeBFRleHQF6QE8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjI2PuS6keWNl%2BWAvuWKm%2BaJk%2BmAoOW6puWBh%2BmFkuW6lzwvYT4mbmJzcDtbMjAxMC82LzIyXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAgMPZBYCZg8PFgIfBgX7ATx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMjU%2B6YeN5bqG5biM5bCU6aG%2F6YWS5bqX6KKr6K2m5pa56LSj5Luk5YGc5Lia5pW06aG%2FPC9hPiZuYnNwO1syMDEwLzYvMjJdPC90ZD48L3RyPjwvdGFibGU%2BZGQCBA9kFgJmDw8WAh8GBfsBPHRhYmxlIHdpZHRoPTEwMCUgIGJvcmRlcj0wPjx0cj48dGQgd2lkdGg9MSBjbGFzcz1ob3Rib3I%2BPGltZyBoZWlnaHQ9NiBzcmM9Li4vaW1hZ2VzL25ld3MuZ2lmIHdpZHRoPTY%2BPC90ZD48dGQgY2xhc3M9aG90Ym9yPjxhIGhyZWY9TmV3c0luZm8uYXNweD9OZXdzSUQ9TjAwMDAwODIyND7plb%2FmmKXluILphZLlupfmjqjlh7rkuJbnlYzmna%2FigJznnIvnkIPmpbzlsYLigJ08L2E%2BJm5ic3A7WzIwMTAvNi8yMl08L3RkPjwvdHI%2BPC90YWJsZT5kZAIFD2QWAmYPDxYCHwYFggI8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjIzPuWQkemrmOenkeaKgOimgeaViOeOhyDphZLlupfkv6Hmga%2FljJborrrlnZvkuInkuprkuL7ooYw8L2E%2BJm5ic3A7WzIwMTAvNi8yMl08L3RkPjwvdHI%2BPC90YWJsZT5kZAIGD2QWAmYPDxYCHwYFgQI8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjIxPuaXhea4uOKAnOWCjeKAneS4iuS4lueVjOadr%2B%2B8jOeZveWkqeWHuua4uOWknOaZmueci%2BeQgzwvYT4mbmJzcDtbMjAxMC82LzE3XTwvdGQ%2BPC90cj48L3RhYmxlPmRkAgcPZBYCZg8PFgIfBgWCAjx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMjA%2B6L%2BQ6JCl5py65p6E6aKR57mB5pu05o2iIOaKlei1hOS6p%2Badg%2BW8j%2BmFkuW6l%2BmavuWPmOeOsDwvYT4mbmJzcDtbMjAxMC82LzE3XTwvdGQ%2BPC90cj48L3RhYmxlPmRkAggPZBYCZg8PFgIfBgWEAjx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTk%2B56Kn5qGC5Zut5LiO5b635Zu9SE1T5Zu96ZmF6YWS5bqX566h55CG6ZuG5Zui6L6%2B5oiQ5ZCI5L2cPC9hPiZuYnNwO1syMDEwLzYvMTddPC90ZD48L3RyPjwvdGFibGU%2BZGQCCQ9kFgJmDw8WAh8GBfsBPHRhYmxlIHdpZHRoPTEwMCUgIGJvcmRlcj0wPjx0cj48dGQgd2lkdGg9MSBjbGFzcz1ob3Rib3I%2BPGltZyBoZWlnaHQ9NiBzcmM9Li4vaW1hZ2VzL25ld3MuZ2lmIHdpZHRoPTY%2BPC90ZD48dGQgY2xhc3M9aG90Ym9yPjxhIGhyZWY9TmV3c0luZm8uYXNweD9OZXdzSUQ9TjAwMDAwODIxOD7mvrPpl6jlo7nlj7flub%2FlnLrlkYjnjK7lhajmlrDosarljY7nlJ%2FmtLvmpoLlv7U8L2E%2BJm5ic3A7WzIwMTAvNi8xN108L3RkPjwvdHI%2BPC90YWJsZT5kZAIKD2QWAmYPDxYCHwYF7wE8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjE3PuadqOa1puWMuummluWutuS6lOaYn%2Be6p%2BmFkuW6l%2BaMgueJjDwvYT4mbmJzcDtbMjAxMC82LzEzXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAgsPZBYCZg8PFgIfBgX1ATx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTY%2B5be05ZOI6ams6YWS5bqX5Lia5q2j5aSE5LqO5aSN6IuP5Y2K6YCU5LitPC9hPiZuYnNwO1syMDEwLzYvMTNdPC90ZD48L3RyPjwvdGFibGU%2BZGQCDA9kFgJmDw8WAh8GBewBPHRhYmxlIHdpZHRoPTEwMCUgIGJvcmRlcj0wPjx0cj48dGQgd2lkdGg9MSBjbGFzcz1ob3Rib3I%2BPGltZyBoZWlnaHQ9NiBzcmM9Li4vaW1hZ2VzL25ld3MuZ2lmIHdpZHRoPTY%2BPC90ZD48dGQgY2xhc3M9aG90Ym9yPjxhIGhyZWY9TmV3c0luZm8uYXNweD9OZXdzSUQ9TjAwMDAwODIxNT7kuJbljZrkvJrorqnkuIrmtbfphZLlupfkuJrnlq%2Fni4I8L2E%2BJm5ic3A7WzIwMTAvNi8xM108L3RkPjwvdHI%2BPC90YWJsZT5kZAIND2QWAmYPDxYCHwYFhAI8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjE0Puilv%2BWuieaXhea4uO%2B8muacquadpeWwhueqgeWHuumFkuW6l%2BS4muWKoeeahOWPkeWxleaImOeVpTwvYT4mbmJzcDtbMjAxMC82LzEyXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAg4PZBYCZg8PFgIfBgX8ATx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTM%2B5oqV6LWE546v5aKD5Y%2BI6KeB55Sf5py6IOaXtuWwmuWTgeeJjOe6t%2BW7uumFkuW6lzwvYT4mbmJzcDtbMjAxMC82LzEyXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAg8PZBYCZg8PFgIfBgX2ATx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTI%2B5Zu95a625oiY55Wl5ZC45byVIOmhtue6p%2BmFkuW6l%2BaKoua7qemHjeW6hjwvYT4mbmJzcDtbMjAxMC82LzExXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAhAPZBYCZg8PFgIfBgWFAjx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTE%2B5LiW5Y2a5Lya5ouJ5Yqo5pWI5bqU5pi%2B546wIOmVv%2BS4ieinkumFkuW6l%2BWHuuenn%2BeOh%2Beci%2Ba2qDwvYT4mbmJzcDtbMjAxMC82LzExXTwvdGQ%2BPC90cj48L3RhYmxlPmRkAhEPZBYCZg8PFgIfBgX3ATx0YWJsZSB3aWR0aD0xMDAlICBib3JkZXI9MD48dHI%2BPHRkIHdpZHRoPTEgY2xhc3M9aG90Ym9yPjxpbWcgaGVpZ2h0PTYgc3JjPS4uL2ltYWdlcy9uZXdzLmdpZiB3aWR0aD02PjwvdGQ%2BPHRkIGNsYXNzPWhvdGJvcj48YSBocmVmPU5ld3NJbmZvLmFzcHg%2FTmV3c0lEPU4wMDAwMDgyMTA%2BaVBhZOaMuui%2Fm%2BS6mua0siDlj5fphZLlupfoiKrnqbrlhazlj7jpnZLnnZA8L2E%2BJm5ic3A7WzIwMTAvNi8xMV08L3RkPjwvdHI%2BPC90YWJsZT5kZAISD2QWAmYPDxYCHwYF9wE8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjA5PumbhemrmOacjeWKoeabtOWQjeS4ukVkZW5yZWQg5pyb5Y2V54us5LiK5biCPC9hPiZuYnNwO1syMDEwLzYvMTBdPC90ZD48L3RyPjwvdGFibGU%2BZGQCEw9kFgJmDw8WAh8GBYQCPHRhYmxlIHdpZHRoPTEwMCUgIGJvcmRlcj0wPjx0cj48dGQgd2lkdGg9MSBjbGFzcz1ob3Rib3I%2BPGltZyBoZWlnaHQ9NiBzcmM9Li4vaW1hZ2VzL25ld3MuZ2lmIHdpZHRoPTY%2BPC90ZD48dGQgY2xhc3M9aG90Ym9yPjxhIGhyZWY9TmV3c0luZm8uYXNweD9OZXdzSUQ9TjAwMDAwODIwNz7kuJbljZrlrqLmtYHigJzmgKXovaznm7TkuIrigJ0gNuaciOS4luWNmueDreW6puWwhui2hTXmnIg8L2E%2BJm5ic3A7WzIwMTAvNi8xMF08L3RkPjwvdHI%2BPC90YWJsZT5kZAIUD2QWAmYPDxYCHwYFiAI8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjA2PuWOpumXqOmFkuW6l%2BWAn%2BS4lueVjOadr%2BaPveeUn%2BaEjyDmjqjlh7rlu7bov5%2FpgIDmiL%2FnrYnmnI3liqE8L2E%2BJm5ic3A7WzIwMTAvNi8xMF08L3RkPjwvdHI%2BPC90YWJsZT5kZAIVD2QWAmYPDxYCHwYFjQI8dGFibGUgd2lkdGg9MTAwJSAgYm9yZGVyPTA%2BPHRyPjx0ZCB3aWR0aD0xIGNsYXNzPWhvdGJvcj48aW1nIGhlaWdodD02IHNyYz0uLi9pbWFnZXMvbmV3cy5naWYgd2lkdGg9Nj48L3RkPjx0ZCBjbGFzcz1ob3Rib3I%2BPGEgaHJlZj1OZXdzSW5mby5hc3B4P05ld3NJRD1OMDAwMDA4MjA1PuS4iua1t%2Be7j%2Ba1juWei%2BmFkuW6l%2BWFpeS9j%2BeOh%2BS6leWWtyDkuJbljZrmuLjlrqLmtYHlkJHlkajovrnln47luII8L2E%2BJm5ic3A7WzIwMTAvNi85XTwvdGQ%2BPC90cj48L3RhYmxlPmRkZHd4jPuzY1UY2FnDzCc131aN9sP1&__EVENTVALIDATION=%2FwEWCwLzh%2BSFCALB7OeECQLB7NMpAsHsv84HAsHsy8wEAsHst%2FELAsHso5YDAsHsj7sKAsHsm7kHAsHsh94OAqaD3soHTx7QP09312UEuA0Aq5tXdUNJpls%3D

jssj2010 发表于 2010-6-23 15:10:02


还是不行采集到的文章网址列表是一样的

jssj2010 发表于 2010-6-23 15:14:49

或者给我传一个汉化版的抓包工具。不知道有没有无毒的

jssj2010 发表于 2010-6-24 15:30:07

哎我真的有点犯傻了。。。
直接把内容网址弄上去就行了，虽然有些可能是空的URL
正在试验中，不知道结果如何

rollce1983 发表于 2010-6-24 20:33:34

我也想知道，有知道的可以MSN我：酷狗设计

hb116114 发表于 2010-6-25 11:32:00

将数字1改成通配符
页: [1]
查看完整版本: 各位高手帮帮忙，这种网站如何采集？