mirror of
https://github.com/NaiboWang/EasySpider.git
synced 2025-04-20 10:05:00 +08:00
V0.3.2 Official
This commit is contained in:
naibo
parent
79d1dfc7e1
commit
e5188b30e8
@ -16,6 +16,21 @@ Tasks can be imported from other machines by simply placing the .json files from
|
||||
|
||||
======Version Update Instruction======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
1. Selected child element operations can delete fields and unmark deleted fields in real-time in the browser.
|
||||
2. Selecting child elements adds a selection mode that allows you to choose only the child elements that are present in all blocks or the child elements that are the same as the first selected block.
|
||||
3. In the text input and webpage open options, you can use the extracted field value as a variable for text input, represented by Field["field_name"].
|
||||
4. Files can be downloaded, such as PDF files.
|
||||
5. Fixed a bug where the software could display a blank screen for about 10 seconds after opening, making it usable in intranets, darknets, and any local network.
|
||||
6. Fixed a bug where the current page URL and title could not be extracted.
|
||||
7. Fixed a bug where OCR recognition could fail to extract information.
|
||||
8. Updated extraction logic to save locally every 10 records collected.
|
||||
9. When modifying a task, the default anchor position is set to after the last operation in the task flow.
|
||||
10. Updated Chrome version to 114.
|
||||
|
||||
-----v0.3.1-----
|
||||
|
||||
1. Advanced Operations:
|
||||
|
||||
@ -15,6 +15,27 @@
|
||||
|
||||
======版本更新说明======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## 更新说明
|
||||
|
||||
1. 选中子元素操作可删除字段并在浏览器中实时取消标记被删除的字段。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/e016c832-6ff9-4814-b86c-38787e73aa30" width=50% />
|
||||
|
||||
2. 选中子元素增加选择模式，可以只选择所有块都有的子元素，或者所有块中和第一个选中的块相同的子元素。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/0082b11d-96bc-43f1-acdb-8280decb48b4" width=50% />
|
||||
|
||||
3. 输入文字和打开网页选项中可以使用最后一次提取到的字段值**作为变量**进行文字输入，用`Field["字段名"]`表示此变量。
|
||||
|
||||
|
||||
4. 可下载文件，如PDF。
|
||||
5. 修复打开后有可能会白屏10秒左右的Bug，使得在内网，暗网以及任意局域网都可以使用软件。
|
||||
6. 修复提取当前页面URL和标题时可能提取不到的bug。
|
||||
7. 修复OCR识别可能提取不到的bug。
|
||||
8. 提取逻辑更新为每采集10条本地保存一次。
|
||||
9. 修改任务时默认锚点位置为任务流程的最后操作后。
|
||||
10. 更新Chrome版本为114。
|
||||
|
||||
-----V0.3.1-----
|
||||
|
||||
如果下载速度慢，可以考虑中国境内下载地址：[中国境内下载地址](https://github.com/NaiboWang/EasySpider/releases/download/v0.3.0/Download_Link_Address_in_China_Mainland.txt)。
|
||||
|
||||
@ -10,6 +10,21 @@ You can import tasks from other machines by simply opening the EasySpider softwa
|
||||
|
||||
======Version Update Instruction======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
1. Selected child element operations can delete fields and unmark deleted fields in real-time in the browser.
|
||||
2. Selecting child elements adds a selection mode that allows you to choose only the child elements that are present in all blocks or the child elements that are the same as the first selected block.
|
||||
3. In the text input and webpage open options, you can use the extracted field value as a variable for text input, represented by Field["field_name"].
|
||||
4. Files can be downloaded, such as PDF files.
|
||||
5. Fixed a bug where the software could display a blank screen for about 10 seconds after opening, making it usable in intranets, darknets, and any local network.
|
||||
6. Fixed a bug where the current page URL and title could not be extracted.
|
||||
7. Fixed a bug where OCR recognition could fail to extract information.
|
||||
8. Updated extraction logic to save locally every 10 records collected.
|
||||
9. When modifying a task, the default anchor position is set to after the last operation in the task flow.
|
||||
10. Updated Chrome version to 114.
|
||||
|
||||
-----V0.3.1-----
|
||||
|
||||
|
||||
|
||||
@ -11,6 +11,28 @@
|
||||
|
||||
======版本更新说明======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## 更新说明
|
||||
|
||||
1. 选中子元素操作可删除字段并在浏览器中实时取消标记被删除的字段。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/e016c832-6ff9-4814-b86c-38787e73aa30" width=50% />
|
||||
|
||||
2. 选中子元素增加选择模式，可以只选择所有块都有的子元素，或者所有块中和第一个选中的块相同的子元素。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/0082b11d-96bc-43f1-acdb-8280decb48b4" width=50% />
|
||||
|
||||
3. 输入文字和打开网页选项中可以使用最后一次提取到的字段值**作为变量**进行文字输入，用`Field["字段名"]`表示此变量。
|
||||
|
||||
|
||||
4. 可下载文件，如PDF。
|
||||
5. 修复打开后有可能会白屏10秒左右的Bug，使得在内网，暗网以及任意局域网都可以使用软件。
|
||||
6. 修复提取当前页面URL和标题时可能提取不到的bug。
|
||||
7. 修复OCR识别可能提取不到的bug。
|
||||
8. 提取逻辑更新为每采集10条本地保存一次。
|
||||
9. 修改任务时默认锚点位置为任务流程的最后操作后。
|
||||
10. 更新Chrome版本为114。
|
||||
|
||||
|
||||
------V0.3.1------
|
||||
|
||||
如果下载速度慢，可以考虑中国境内下载地址：[中国境内下载地址](https://github.com/NaiboWang/EasySpider/releases/download/v0.3.0/Download_Link_Address_in_China_Mainland.txt)。
|
||||
|
||||
@ -4,6 +4,8 @@ Welcome to promote this software to other friends.
|
||||
|
||||
This version is for Windows 10 x64 and above.
|
||||
|
||||
The Windows version supports **Windows 10 and above**. There is no direct usable version available for Windows 7, but the [32-bit version](https://github.com/NaiboWang/EasySpider/releases/download/v0.2.0/EasySpider_0.2.0_windows_386.7z) of [v0.2.0](https://github.com/NaiboWang/EasySpider/releases/download/v0.2.0) is available and can be run by compiling the software yourself. Therefore, if you want to use Windows 7 for data collection, please download the 32-bit version of v0.2.0 or download the code and compile it yourself.
|
||||
|
||||
Video Tutorial: https://youtube.com/playlist?list=PL0kEFEkWrT7mt9MUlEBV2DTo1QsaanUTp
|
||||
|
||||
The software is totally not trojan/virus! If mistaken by antivirus software such as Windows Defender as a virus, please recover it, or open "EasySpider.bat" to run our software instead.
|
||||
@ -13,6 +15,21 @@ Tasks can be imported from other machines by simply placing the .json files from
|
||||
|
||||
======Version Update Instructions======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
1. Selected child element operations can delete fields and unmark deleted fields in real-time in the browser.
|
||||
2. Selecting child elements adds a selection mode that allows you to choose only the child elements that are present in all blocks or the child elements that are the same as the first selected block.
|
||||
3. In the text input and webpage open options, you can use the extracted field value as a variable for text input, represented by Field["field_name"].
|
||||
4. Files can be downloaded, such as PDF files.
|
||||
5. Fixed a bug where the software could display a blank screen for about 10 seconds after opening, making it usable in intranets, darknets, and any local network.
|
||||
6. Fixed a bug where the current page URL and title could not be extracted.
|
||||
7. Fixed a bug where OCR recognition could fail to extract information.
|
||||
8. Updated extraction logic to save locally every 10 records collected.
|
||||
9. When modifying a task, the default anchor position is set to after the last operation in the task flow.
|
||||
10. Updated Chrome version to 114.
|
||||
|
||||
-----v0.3.1-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@ -1 +0,0 @@
|
||||
{"id":10,"name":"BigSpy","url":"https://bigspy.com/adspy/facebook/?app_type=3","links":"https://bigspy.com/adspy/facebook/?app_type=3","create_time":"6/2/2023, 10:20:57 PM","version":"0.3.2","containJudge":false,"desc":"https://bigspy.com/adspy/facebook/?app_type=3","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://bigspy.com/adspy/facebook/?app_type=3","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://bigspy.com/adspy/facebook/?app_type=3"}],"outputParameters":[],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":500,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://bigspy.com/adspy/facebook/?app_type=3","links":"https://bigspy.com/adspy/facebook/?app_type=3","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}}]}
|
||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@ -1,437 +0,0 @@
|
||||
{
|
||||
"id": 17,
|
||||
"name": "名录产品检索",
|
||||
"url": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"links"
|
||||
"create_time": "6/7/2023, 10:20:17 PM",
|
||||
"version": "0.3.2",
|
||||
"containJudge": true,
|
||||
"desc": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"inputParameters": [
|
||||
{
|
||||
"id": 0,
|
||||
"name": "loopTimes_循环点击下一页_0",
|
||||
"nodeId": 3,
|
||||
"nodeName": "循环点击下一页",
|
||||
"desc": "循环循环点击下一页执行的次数（0代表无限循环）",
|
||||
"type": "int",
|
||||
"exampleValue": 0,
|
||||
"value": 0
|
||||
},
|
||||
{
|
||||
"id": 1,
|
||||
"name": "urlList_1",
|
||||
"nodeId": 12,
|
||||
"nodeName": "打开网页",
|
||||
"value": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"desc": "要采集的网址列表，多行以\\n分开",
|
||||
"type": "string",
|
||||
"exampleValue": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360"
|
||||
}
|
||||
],
|
||||
"outputParameters": [
|
||||
{
|
||||
"id": 0,
|
||||
"name": "自定义参数_0",
|
||||
"desc": "",
|
||||
"type": "string",
|
||||
"exampleValue": "自定义字段"
|
||||
}
|
||||
],
|
||||
"graph": [
|
||||
{
|
||||
"index": 0,
|
||||
"id": 0,
|
||||
"parentId": 0,
|
||||
"type": -1,
|
||||
"option": 0,
|
||||
"title": "root",
|
||||
"sequence": [
|
||||
12,
|
||||
3
|
||||
],
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0
|
||||
},
|
||||
"isInLoop": false
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"index": 1,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"links": "emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"index": 2,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"links": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 2,
|
||||
"index": 3,
|
||||
"parentId": 0,
|
||||
"type": 1,
|
||||
"option": 8,
|
||||
"title": "循环点击下一页",
|
||||
"sequence": [
|
||||
5,
|
||||
4
|
||||
],
|
||||
"isInLoop": false,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 4,
|
||||
"tabIndex": -1,
|
||||
"useLoop": false,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[last()]/font[1]",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"loopType": 0,
|
||||
"pathList": "",
|
||||
"textList": "",
|
||||
"code": "",
|
||||
"waitTime": 0,
|
||||
"exitCount": 0,
|
||||
"historyWait": 2,
|
||||
"breakMode": 0,
|
||||
"breakCode": "",
|
||||
"breakCodeWaitTime": 0,
|
||||
"allXPaths": [
|
||||
"/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"//font[contains(., '下一页')]"
|
||||
]
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 4,
|
||||
"index": 4,
|
||||
"parentId": 2,
|
||||
"type": 0,
|
||||
"option": 2,
|
||||
"title": "点击元素",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 4,
|
||||
"tabIndex": -1,
|
||||
"useLoop": true,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"wait": 2,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"maxWaitTime": 10,
|
||||
"paras": [],
|
||||
"allXPaths": [
|
||||
"/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"//font[contains(., '下一页')]"
|
||||
],
|
||||
"loopType": 0
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 3,
|
||||
"index": 5,
|
||||
"parentId": 2,
|
||||
"type": 1,
|
||||
"option": 8,
|
||||
"title": "循环",
|
||||
"sequence": [
|
||||
7,
|
||||
6
|
||||
],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 5,
|
||||
"tabIndex": -1,
|
||||
"useLoop": false,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table/tbody[1]/tr[1]/td[1]/a[1]",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"loopType": 1,
|
||||
"pathList": "",
|
||||
"textList": "",
|
||||
"code": "",
|
||||
"waitTime": 0,
|
||||
"exitCount": 0,
|
||||
"historyWait": 2,
|
||||
"breakMode": 0,
|
||||
"breakCode": "",
|
||||
"breakCodeWaitTime": 0,
|
||||
"allXPaths": ""
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 6,
|
||||
"index": 6,
|
||||
"parentId": 3,
|
||||
"type": 0,
|
||||
"option": 2,
|
||||
"title": "点击元素",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 5,
|
||||
"tabIndex": -1,
|
||||
"useLoop": true,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table/tbody[1]/tr[1]/td[1]/a[1]",
|
||||
"wait": 2,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"maxWaitTime": 10,
|
||||
"paras": [],
|
||||
"allXPaths": "",
|
||||
"loopType": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 5,
|
||||
"index": 7,
|
||||
"parentId": 3,
|
||||
"type": 2,
|
||||
"option": 9,
|
||||
"title": "判断条件",
|
||||
"sequence": [
|
||||
10
|
||||
],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"parentId": 5,
|
||||
"index": 8,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": "0",
|
||||
"value": "上一页",
|
||||
"code": "return arguments.innerText",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 1
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"parentId": 5,
|
||||
"index": 9,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": 0,
|
||||
"value": "",
|
||||
"code": "",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 1
|
||||
},
|
||||
{
|
||||
"index": 10,
|
||||
"id": 7,
|
||||
"parentId": 5,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [
|
||||
11
|
||||
],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": "7",
|
||||
"value": "上一页",
|
||||
"code": "return arguments[0].nextElementSibling.nextSibling.innerText.includes(\"免费资源\") && !arguments[0].innerText.includes(\"上一页\")",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 0
|
||||
},
|
||||
{
|
||||
"id": 8,
|
||||
"index": 11,
|
||||
"parentId": 7,
|
||||
"type": 0,
|
||||
"option": 3,
|
||||
"title": "提取数据",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"paras": [
|
||||
{
|
||||
"nodeType": 0,
|
||||
"contentType": 0,
|
||||
"relative": false,
|
||||
"name": "自定义参数_0",
|
||||
"desc": "",
|
||||
"extractType": 0,
|
||||
"relativeXPath": "/html/body/table/tbody/tr/td/table[3]/tbody/tr/td[2]",
|
||||
"allXPaths": [],
|
||||
"exampleValues": [
|
||||
{
|
||||
"num": 0,
|
||||
"value": "自定义字段"
|
||||
}
|
||||
],
|
||||
"default": "",
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"JS": "",
|
||||
"JSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"downloadPic": 0
|
||||
}
|
||||
]
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 1,
|
||||
"index": 12,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"links": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
}
|
||||
]
|
||||
}
|
||||
@ -1,436 +0,0 @@
|
||||
{
|
||||
"id": 18,
|
||||
"name": "名录产品检索",
|
||||
"url": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"create_time": "6/7/2023, 10:20:17 PM",
|
||||
"version": "0.3.2",
|
||||
"containJudge": true,
|
||||
"desc": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"inputParameters": [
|
||||
{
|
||||
"id": 0,
|
||||
"name": "loopTimes_循环点击下一页_0",
|
||||
"nodeId": 3,
|
||||
"nodeName": "循环点击下一页",
|
||||
"desc": "循环循环点击下一页执行的次数（0代表无限循环）",
|
||||
"type": "int",
|
||||
"exampleValue": 0,
|
||||
"value": 0
|
||||
},
|
||||
{
|
||||
"id": 1,
|
||||
"name": "urlList_1",
|
||||
"nodeId": 12,
|
||||
"nodeName": "打开网页",
|
||||
"value": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"desc": "要采集的网址列表，多行以\\n分开",
|
||||
"type": "string",
|
||||
"exampleValue": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360"
|
||||
}
|
||||
],
|
||||
"outputParameters": [
|
||||
{
|
||||
"id": 0,
|
||||
"name": "自定义参数_0",
|
||||
"desc": "",
|
||||
"type": "string",
|
||||
"exampleValue": "自定义字段"
|
||||
}
|
||||
],
|
||||
"graph": [
|
||||
{
|
||||
"index": 0,
|
||||
"id": 0,
|
||||
"parentId": 0,
|
||||
"type": -1,
|
||||
"option": 0,
|
||||
"title": "root",
|
||||
"sequence": [
|
||||
12,
|
||||
3
|
||||
],
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0
|
||||
},
|
||||
"isInLoop": false
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"index": 1,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"links": "emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"index": 2,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"links": "https://emagecompany.com/search.php?key=协会&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 2,
|
||||
"index": 3,
|
||||
"parentId": 0,
|
||||
"type": 1,
|
||||
"option": 8,
|
||||
"title": "循环点击下一页",
|
||||
"sequence": [
|
||||
5,
|
||||
4
|
||||
],
|
||||
"isInLoop": false,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 4,
|
||||
"tabIndex": -1,
|
||||
"useLoop": false,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[last()]/font[1]",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"loopType": 0,
|
||||
"pathList": "",
|
||||
"textList": "",
|
||||
"code": "",
|
||||
"waitTime": 0,
|
||||
"exitCount": 0,
|
||||
"historyWait": 2,
|
||||
"breakMode": 0,
|
||||
"breakCode": "",
|
||||
"breakCodeWaitTime": 0,
|
||||
"allXPaths": [
|
||||
"/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"//font[contains(., '下一页')]"
|
||||
]
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 4,
|
||||
"index": 4,
|
||||
"parentId": 2,
|
||||
"type": 0,
|
||||
"option": 2,
|
||||
"title": "点击元素",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 4,
|
||||
"tabIndex": -1,
|
||||
"useLoop": true,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"wait": 2,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"maxWaitTime": 10,
|
||||
"paras": [],
|
||||
"allXPaths": [
|
||||
"/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table[13]/tbody[1]/tr[1]/td[1]/a[11]/font[1]",
|
||||
"//font[contains(., '下一页')]"
|
||||
],
|
||||
"loopType": 0
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 3,
|
||||
"index": 5,
|
||||
"parentId": 2,
|
||||
"type": 1,
|
||||
"option": 8,
|
||||
"title": "循环",
|
||||
"sequence": [
|
||||
7,
|
||||
6
|
||||
],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 5,
|
||||
"tabIndex": -1,
|
||||
"useLoop": false,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table/tbody[1]/tr[1]/td[1]/a[1]",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"loopType": 1,
|
||||
"pathList": "",
|
||||
"textList": "",
|
||||
"code": "",
|
||||
"waitTime": 0,
|
||||
"exitCount": 0,
|
||||
"historyWait": 2,
|
||||
"breakMode": 0,
|
||||
"breakCode": "",
|
||||
"breakCodeWaitTime": 0,
|
||||
"allXPaths": ""
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 6,
|
||||
"index": 6,
|
||||
"parentId": 3,
|
||||
"type": 0,
|
||||
"option": 2,
|
||||
"title": "点击元素",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 1,
|
||||
"parameters": {
|
||||
"history": 5,
|
||||
"tabIndex": -1,
|
||||
"useLoop": true,
|
||||
"xpath": "/html/body/table[1]/tbody[1]/tr[1]/td[1]/table[3]/tbody[1]/tr[1]/td[2]/table[1]/tbody[1]/tr[3]/td[1]/table/tbody[1]/tr[1]/td[1]/a[1]",
|
||||
"wait": 2,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1,
|
||||
"maxWaitTime": 10,
|
||||
"paras": [],
|
||||
"allXPaths": "",
|
||||
"loopType": 1
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 5,
|
||||
"index": 7,
|
||||
"parentId": 3,
|
||||
"type": 2,
|
||||
"option": 9,
|
||||
"title": "判断条件",
|
||||
"sequence": [
|
||||
10
|
||||
],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"parentId": 5,
|
||||
"index": 8,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": "0",
|
||||
"value": "上一页",
|
||||
"code": "return arguments.innerText",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 1
|
||||
},
|
||||
{
|
||||
"id": -1,
|
||||
"parentId": 5,
|
||||
"index": 9,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": 0,
|
||||
"value": "",
|
||||
"code": "",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 1
|
||||
},
|
||||
{
|
||||
"index": 10,
|
||||
"id": 7,
|
||||
"parentId": 5,
|
||||
"type": 3,
|
||||
"option": 10,
|
||||
"title": "条件分支",
|
||||
"sequence": [
|
||||
11
|
||||
],
|
||||
"isInLoop": true,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"class": "7",
|
||||
"value": "上一页",
|
||||
"code": "return arguments[0].nextElementSibling.nextSibling.innerText.includes(\"免费资源\") && !arguments[0].innerText.includes(\"上一页\")",
|
||||
"waitTime": 0
|
||||
},
|
||||
"position": 0
|
||||
},
|
||||
{
|
||||
"id": 8,
|
||||
"index": 11,
|
||||
"parentId": 7,
|
||||
"type": 0,
|
||||
"option": 3,
|
||||
"title": "提取数据",
|
||||
"sequence": [],
|
||||
"isInLoop": true,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"paras": [
|
||||
{
|
||||
"nodeType": 0,
|
||||
"contentType": 0,
|
||||
"relative": false,
|
||||
"name": "自定义参数_0",
|
||||
"desc": "",
|
||||
"extractType": 0,
|
||||
"relativeXPath": "/html/body/table/tbody/tr/td/table[3]/tbody/tr/td[2]",
|
||||
"allXPaths": [],
|
||||
"exampleValues": [
|
||||
{
|
||||
"num": 0,
|
||||
"value": "自定义字段"
|
||||
}
|
||||
],
|
||||
"default": "",
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"JS": "",
|
||||
"JSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"downloadPic": 0
|
||||
}
|
||||
]
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": 1,
|
||||
"index": 12,
|
||||
"parentId": 0,
|
||||
"type": 0,
|
||||
"option": 1,
|
||||
"title": "打开网页",
|
||||
"sequence": [],
|
||||
"isInLoop": false,
|
||||
"position": 0,
|
||||
"parameters": {
|
||||
"history": 1,
|
||||
"tabIndex": 0,
|
||||
"useLoop": false,
|
||||
"xpath": "",
|
||||
"wait": 0,
|
||||
"beforeJS": "",
|
||||
"beforeJSWaitTime": 0,
|
||||
"afterJS": "",
|
||||
"afterJSWaitTime": 0,
|
||||
"url": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"links": "https://emagecompany.com/search.php?key=%E5%8D%8F%E4%BC%9A&page=1&total=360",
|
||||
"maxWaitTime": 10,
|
||||
"scrollType": 0,
|
||||
"scrollCount": 1,
|
||||
"scrollWaitTime": 1
|
||||
}
|
||||
}
|
||||
]
|
||||
}
|
||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@ -1 +0,0 @@
|
||||
{"id":7,"name":"芜湖房地产交易信息网","url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","create_time":"6/1/2023, 11:56:32 AM","version":"0.3.2","containJudge":false,"desc":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index"}],"outputParameters":[{"id":0,"name":"参数1_文本","desc":"","type":"string","exampleValue":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,2],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":2,"index":2,"parentId":0,"type":1,"option":8,"title":"循环","sequence":[3,4],"isInLoop":false,"position":1,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"loopType":1,"pathList":"","textList":"","code":"","waitTime":0,"exitCount":0,"historyWait":2,"breakMode":0,"breakCode":"","breakCodeWaitTime":0,"allXPaths":""}},{"id":3,"index":3,"parentId":2,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":true,"position":0,"parameters":{"history":4,"tabIndex":-1,"useLoop":true,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":"","loopType":1}},{"id":4,"index":4,"parentId":2,"type":0,"option":3,"title":"提取数据","sequence":[],"isInLoop":true,"position":1,"parameters":{"history":1,"tabIndex":-1,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"paras":[{"nodeType":0,"contentType":0,"relative":false,"name":"参数1_文本","desc":"","extractType":0,"relativeXPath":"/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","allXPaths":["/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","//div[contains(., '伟星')]","//DIV[@class='project-detail__name']"],"exampleValues":[{"num":0,"value":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0}]}}]}
|
||||
@ -1 +0,0 @@
|
||||
{"id":8,"name":"芜湖房地产交易信息网","url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","create_time":"6/1/2023, 12:03:07 PM","version":"0.3.2","containJudge":false,"desc":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index"},{"id":1,"name":"loopTimes_循环_1","nodeId":5,"nodeName":"循环","desc":"循环循环执行的次数（0代表无限循环）","type":"int","exampleValue":0,"value":0}],"outputParameters":[{"id":0,"name":"参数1_文本","desc":"","type":"string","exampleValue":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,5],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":3,"index":2,"parentId":2,"type":1,"option":8,"title":"循环","sequence":[3,4],"isInLoop":true,"position":0,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"loopType":1,"pathList":"","textList":"","code":"","waitTime":0,"exitCount":0,"historyWait":2,"breakMode":0,"breakCode":"","breakCodeWaitTime":0,"allXPaths":""}},{"id":5,"index":3,"parentId":3,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":true,"position":0,"parameters":{"history":4,"tabIndex":-1,"useLoop":true,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":"","loopType":1}},{"id":6,"index":4,"parentId":3,"type":0,"option":3,"title":"提取数据","sequence":[],"isInLoop":true,"position":1,"parameters":{"history":1,"tabIndex":-1,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"paras":[{"nodeType":0,"contentType":0,"relative":false,"name":"参数1_文本","desc":"","extractType":0,"relativeXPath":"/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","allXPaths":["/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","//div[contains(., '伟星')]","//DIV[@class='project-detail__name']"],"exampleValues":[{"num":0,"value":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0}]}},{"id":2,"index":5,"parentId":0,"type":1,"option":8,"title":"循环","sequence":[2,6],"isInLoop":false,"position":1,"parameters":{"history":3,"tabIndex":-1,"useLoop":false,"xpath":"//*[contains(@class, \"laypage_next\")]","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"loopType":0,"pathList":"","textList":"","code":"","waitTime":0,"exitCount":0,"historyWait":2,"breakMode":0,"breakCode":"","breakCodeWaitTime":0,"allXPaths":["/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/div[1]/div[1]/a[6]","//a[contains(., '>')]","//A[@class='laypage_next']"]}},{"id":4,"index":6,"parentId":2,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":true,"position":1,"parameters":{"history":3,"tabIndex":-1,"useLoop":true,"xpath":"//*[contains(@class, \"laypage_next\")]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":["/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/div[1]/div[1]/a[6]","//a[contains(., '>')]","//A[@class='laypage_next']"],"loopType":0}}]}
|
||||
@ -1 +0,0 @@
|
||||
{"id":9,"name":"芜湖房地产交易信息网","url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","create_time":"6/1/2023, 12:03:07 PM","version":"0.3.2","containJudge":false,"desc":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index"},{"id":1,"name":"loopTimes_循环_1","nodeId":5,"nodeName":"循环","desc":"循环循环执行的次数（0代表无限循环）","type":"int","exampleValue":0,"value":0}],"outputParameters":[{"id":0,"name":"参数1_文本","desc":"","type":"string","exampleValue":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,5],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","links":"https://www.whfdcjy.cn:8065/website/app/NewHouse/index","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":3,"index":2,"parentId":2,"type":1,"option":8,"title":"循环","sequence":[3,4],"isInLoop":true,"position":0,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"loopType":1,"pathList":"","textList":"","code":"","waitTime":0,"exitCount":0,"historyWait":2,"breakMode":0,"breakCode":"","breakCodeWaitTime":0,"allXPaths":""}},{"id":5,"index":3,"parentId":3,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":true,"position":0,"parameters":{"history":4,"tabIndex":-1,"useLoop":true,"xpath":"/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/ul[1]/li/ul[1]/li[1]/a[1]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":"","loopType":1}},{"id":6,"index":4,"parentId":3,"type":0,"option":3,"title":"提取数据","sequence":[],"isInLoop":true,"position":1,"parameters":{"history":1,"tabIndex":-1,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"paras":[{"nodeType":0,"contentType":0,"relative":false,"name":"参数1_文本","desc":"","extractType":0,"relativeXPath":"/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","allXPaths":["/html/body/div[2]/div[2]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]","//div[contains(., '伟星')]","//DIV[@class='project-detail__name']"],"exampleValues":[{"num":0,"value":"\n\t\t\t\t\t\t\t伟星天玺\n\t\t\t\t\t\t\t规划用途：住宅、商业\n\t\t\t\t\t\t"}],"default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0}]}},{"id":2,"index":5,"parentId":0,"type":1,"option":8,"title":"循环","sequence":[2,6],"isInLoop":false,"position":1,"parameters":{"history":3,"tabIndex":-1,"useLoop":false,"xpath":"//*[contains(@class, \"laypage_next\")]","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"loopType":0,"pathList":"","textList":"","code":"","waitTime":0,"exitCount":0,"historyWait":2,"breakMode":0,"breakCode":"","breakCodeWaitTime":0,"allXPaths":["/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/div[1]/div[1]/a[6]","//a[contains(., '>')]","//A[@class='laypage_next']"]}},{"id":4,"index":6,"parentId":2,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":true,"position":1,"parameters":{"history":3,"tabIndex":-1,"useLoop":true,"xpath":"//*[contains(@class, \"laypage_next\")]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":["/html/body/div[2]/div[3]/div[1]/div[1]/div[2]/div[1]/div[1]/a[6]","//a[contains(., '>')]","//A[@class='laypage_next']"],"loopType":0}}]}
|
||||
@ -4,6 +4,8 @@
|
||||
|
||||
支持Windows 10 x64及以上版本。
|
||||
|
||||
Windows 7此版本无直接可用版本（因为Chrome 109是最后一个支持Windows 7的Chrome版本），但v0.2.0的32位版本可用，且可以通过自行编译软件来运行，因此如想使用Windows 7采集数据，请下载v0.2.0的32位版本或自行下载代码并编译：https://github.com/NaiboWang/EasySpider/releases/tag/v0.2.0
|
||||
|
||||
视频教程：https://www.bilibili.com/video/BV1Fk4y1L7xX/
|
||||
|
||||
这个软件绝对不是特洛伊木马/病毒！如果被像Windows Defender这样的杀毒软件误认为是病毒，请进行恢复，或者打开“EasySpider.bat”来运行我们的软件。
|
||||
@ -13,6 +15,28 @@
|
||||
|
||||
======版本更新说明======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## 更新说明
|
||||
|
||||
1. 选中子元素操作可删除字段并在浏览器中实时取消标记被删除的字段。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/e016c832-6ff9-4814-b86c-38787e73aa30" width=50% />
|
||||
|
||||
2. 选中子元素增加选择模式，可以只选择所有块都有的子元素，或者所有块中和第一个选中的块相同的子元素。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/0082b11d-96bc-43f1-acdb-8280decb48b4" width=50% />
|
||||
|
||||
3. 输入文字和打开网页选项中可以使用最后一次提取到的字段值**作为变量**进行文字输入，用`Field["字段名"]`表示此变量。
|
||||
|
||||
|
||||
4. 可下载文件，如PDF。
|
||||
5. 修复打开后有可能会白屏10秒左右的Bug，使得在内网，暗网以及任意局域网都可以使用软件。
|
||||
6. 修复提取当前页面URL和标题时可能提取不到的bug。
|
||||
7. 修复OCR识别可能提取不到的bug。
|
||||
8. 提取逻辑更新为每采集10条本地保存一次。
|
||||
9. 修改任务时默认锚点位置为任务流程的最后操作后。
|
||||
10. 更新Chrome版本为114。
|
||||
|
||||
|
||||
-----v0.3.1-----
|
||||
|
||||
### 强烈建议大家观看新特性讲解视频
|
||||
|
||||
@ -4,6 +4,8 @@ Welcome to promote this software to other friends.
|
||||
|
||||
This version is for Windows 10 x32 and above.
|
||||
|
||||
The Windows version supports **Windows 10 and above**. There is no direct usable version available for Windows 7, but the [32-bit version](https://github.com/NaiboWang/EasySpider/releases/download/v0.2.0/EasySpider_0.2.0_windows_386.7z) of [v0.2.0](https://github.com/NaiboWang/EasySpider/releases/download/v0.2.0) is available and can be run by compiling the software yourself. Therefore, if you want to use Windows 7 for data collection, please download the 32-bit version of v0.2.0 or download the code and compile it yourself.
|
||||
|
||||
Video Tutorial: https://youtube.com/playlist?list=PL0kEFEkWrT7mt9MUlEBV2DTo1QsaanUTp
|
||||
|
||||
The software is totally not trojan/virus! If mistaken by antivirus software such as Windows Defender as a virus, please recover it, or open "EasySpider.bat" to run our software instead.
|
||||
@ -13,6 +15,21 @@ Tasks can be imported from other machines by simply placing the .json files from
|
||||
|
||||
======Version New Features======
|
||||
|
||||
-----v0.3.2-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
1. Selected child element operations can delete fields and unmark deleted fields in real-time in the browser.
|
||||
2. Selecting child elements adds a selection mode that allows you to choose only the child elements that are present in all blocks or the child elements that are the same as the first selected block.
|
||||
3. In the text input and webpage open options, you can use the extracted field value as a variable for text input, represented by Field["field_name"].
|
||||
4. Files can be downloaded, such as PDF files.
|
||||
5. Fixed a bug where the software could display a blank screen for about 10 seconds after opening, making it usable in intranets, darknets, and any local network.
|
||||
6. Fixed a bug where the current page URL and title could not be extracted.
|
||||
7. Fixed a bug where OCR recognition could fail to extract information.
|
||||
8. Updated extraction logic to save locally every 10 records collected.
|
||||
9. When modifying a task, the default anchor position is set to after the last operation in the task flow.
|
||||
10. Updated Chrome version to 114.
|
||||
|
||||
-----v0.3.1-----
|
||||
|
||||
## Update Instruction
|
||||
|
||||
1
.temp_to_pub/EasySpider_windows_x86/tasks/34.json
Normal file
1
.temp_to_pub/EasySpider_windows_x86/tasks/34.json
Normal file
File diff suppressed because one or more lines are too long
1
.temp_to_pub/EasySpider_windows_x86/tasks/35.json
Normal file
1
.temp_to_pub/EasySpider_windows_x86/tasks/35.json
Normal file
@ -0,0 +1 @@
|
||||
{"id":35,"name":"京东(JD.COM)-正品低价、品质保障、配送及时、轻松购物！","url":"https://www.jd.com","links":"Field[\"参数1_链接地址\"]","create_time":"6/8/2023, 12:37:20 AM","version":"0.3.2","containJudge":false,"desc":"https://www.jd.com","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://www.jd.com","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://www.jd.com"},{"id":1,"name":"urlList_1","nodeId":3,"nodeName":"打开网页","value":"Field[\"参数1_链接地址\"]","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"Field[\"参数1_链接地址\"]"}],"outputParameters":[{"id":0,"name":"参数1_链接地址","desc":"","type":"string","exampleValue":"https://pro.jd.com/mall/active/36yPbWm4JqFrmTgABydz6GkWNkca/index.html"}],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,2,3],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://www.jd.com","links":"https://www.jd.com","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":2,"index":2,"parentId":0,"type":0,"option":3,"title":"提取数据","sequence":[],"isInLoop":false,"position":1,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"paras":[{"nodeType":2,"contentType":0,"relative":false,"name":"参数1_链接地址","desc":"","relativeXPath":"/html/body/div[1]/div[4]/div[1]/div[4]/ul[1]/li[1]/a[1]","allXPaths":["/html/body/div[1]/div[4]/div[1]/div[4]/ul[1]/li[1]/a[1]","//a[contains(., '京东超市')]","//A[@class='navitems-lk']"],"exampleValues":[{"num":0,"value":"https://pro.jd.com/mall/active/36yPbWm4JqFrmTgABydz6GkWNkca/index.html"}],"unique_index":"j7p3sc19pblilxn0ey","default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0}]}},{"id":3,"index":3,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":2,"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"about:blank","links":"Field[\"参数1_链接地址\"]","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}}]}
|
||||
1
.temp_to_pub/EasySpider_windows_x86/tasks/36.json
Normal file
1
.temp_to_pub/EasySpider_windows_x86/tasks/36.json
Normal file
@ -0,0 +1 @@
|
||||
{"id":36,"name":"京东(JD.COM)-正品低价、品质保障、配送及时、轻松购物！","url":"https://www.jd.com","links":"https://www.jd.com","create_time":"6/8/2023, 12:39:11 AM","version":"0.3.2","containJudge":false,"desc":"https://www.jd.com","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://www.jd.com","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://www.jd.com"}],"outputParameters":[{"id":0,"name":"参数1_图片页面标题","desc":"","type":"string","exampleValue":"京东(JD.COM)-正品低价、品质保障、配送及时、轻松购物！"},{"id":1,"name":"参数2_页面网址","desc":"","type":"string","exampleValue":"https://www.jd.com/"}],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,2],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://www.jd.com","links":"https://www.jd.com","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":2,"index":2,"parentId":0,"type":0,"option":3,"title":"提取数据","sequence":[],"isInLoop":false,"position":1,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"paras":[{"nodeType":4,"contentType":6,"relative":false,"name":"参数1_图片页面标题","desc":"","extractType":0,"relativeXPath":"/html/body/div[1]/div[5]/div[1]/div[2]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[1]/li[3]/a[1]/img[1]","allXPaths":["/html/body/div[1]/div[5]/div[1]/div[2]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[1]/li[3]/a[1]/img[1]","//img[contains(., '')]","//IMG[@class='focus-item-img']"],"exampleValues":[{"num":0,"value":"京东(JD.COM)-正品低价、品质保障、配送及时、轻松购物！"}],"unique_index":"n5npo776r8rlilxpm39","default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0},{"nodeType":3,"contentType":5,"relative":false,"name":"参数2_页面网址","desc":"","extractType":0,"relativeXPath":"/html/body/div[1]/div[4]/div[1]/div[2]/div[1]/div[2]/input[1]","allXPaths":["/html/body/div[1]/div[4]/div[1]/div[2]/div[1]/div[2]/input[1]","//input[contains(., '')]","id(\"key\")","//INPUT[@class='text']"],"exampleValues":[{"num":0,"value":"https://www.jd.com/"}],"unique_index":"rr4qi9i0fmlilxppvw","default":"","beforeJS":"","beforeJSWaitTime":0,"JS":"","JSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"downloadPic":0}]}}]}
|
||||
@ -4,6 +4,8 @@
|
||||
|
||||
支持Windows 10 x32及以上版本。
|
||||
|
||||
Windows 7此版本无直接可用版本（因为Chrome 109是最后一个支持Windows 7的Chrome版本），但v0.2.0的32位版本可用，且可以通过自行编译软件来运行，因此如想使用Windows 7采集数据，请下载v0.2.0的32位版本或自行下载代码并编译：https://github.com/NaiboWang/EasySpider/releases/tag/v0.2.0
|
||||
|
||||
视频教程：https://www.bilibili.com/video/BV1Fk4y1L7xX/
|
||||
|
||||
这个软件绝对不是特洛伊木马/病毒！如果被像Windows Defender这样的杀毒软件误认为是病毒，请进行恢复，或者打开“EasySpider.bat”来运行我们的软件。
|
||||
@ -12,6 +14,27 @@
|
||||
|
||||
|
||||
======版本更新说明======
|
||||
-----v0.3.2-----
|
||||
|
||||
## 更新说明
|
||||
|
||||
1. 选中子元素操作可删除字段并在浏览器中实时取消标记被删除的字段。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/e016c832-6ff9-4814-b86c-38787e73aa30" width=50% />
|
||||
|
||||
2. 选中子元素增加选择模式，可以只选择所有块都有的子元素，或者所有块中和第一个选中的块相同的子元素。
|
||||
<img src="https://github.com/NaiboWang/EasySpider/assets/30287768/0082b11d-96bc-43f1-acdb-8280decb48b4" width=50% />
|
||||
|
||||
3. 输入文字和打开网页选项中可以使用最后一次提取到的字段值**作为变量**进行文字输入，用`Field["字段名"]`表示此变量。
|
||||
|
||||
|
||||
4. 可下载文件，如PDF。
|
||||
5. 修复打开后有可能会白屏10秒左右的Bug，使得在内网，暗网以及任意局域网都可以使用软件。
|
||||
6. 修复提取当前页面URL和标题时可能提取不到的bug。
|
||||
7. 修复OCR识别可能提取不到的bug。
|
||||
8. 提取逻辑更新为每采集10条本地保存一次。
|
||||
9. 修改任务时默认锚点位置为任务流程的最后操作后。
|
||||
10. 更新Chrome版本为114。
|
||||
|
||||
|
||||
-----v0.3.1-----
|
||||
|
||||
|
||||
1
ElectronJS/tasks/98.json
Normal file
1
ElectronJS/tasks/98.json
Normal file
File diff suppressed because one or more lines are too long
1
ElectronJS/tasks/99.json
Normal file
1
ElectronJS/tasks/99.json
Normal file
@ -0,0 +1 @@
|
||||
{"id":99,"name":"[2305.07067] SigRec: Automatic Recovery of Function Signatures in Smart Contracts","url":"https://arxiv.org/abs/2305.07067","links":"https://arxiv.org/abs/2305.07067","create_time":"6/7/2023, 11:59:18 PM","version":"0.3.2","containJudge":false,"desc":"https://arxiv.org/abs/2305.07067","inputParameters":[{"id":0,"name":"urlList_0","nodeId":1,"nodeName":"打开网页","value":"https://arxiv.org/abs/2305.07067","desc":"要采集的网址列表，多行以\\n分开","type":"string","exampleValue":"https://arxiv.org/abs/2305.07067"}],"outputParameters":[],"graph":[{"index":0,"id":0,"parentId":0,"type":-1,"option":0,"title":"root","sequence":[1,2],"parameters":{"history":1,"tabIndex":0,"useLoop":false,"xpath":"","wait":0},"isInLoop":false},{"id":1,"index":1,"parentId":0,"type":0,"option":1,"title":"打开网页","sequence":[],"isInLoop":false,"position":0,"parameters":{"useLoop":false,"xpath":"","wait":0,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"url":"https://arxiv.org/abs/2305.07067","links":"https://arxiv.org/abs/2305.07067","maxWaitTime":10,"scrollType":0,"scrollCount":1,"scrollWaitTime":1}},{"id":2,"index":2,"parentId":0,"type":0,"option":2,"title":"点击元素","sequence":[],"isInLoop":false,"position":1,"parameters":{"history":4,"tabIndex":-1,"useLoop":false,"xpath":"//*[contains(@class, \"download-pdf\")]","wait":2,"beforeJS":"","beforeJSWaitTime":0,"afterJS":"","afterJSWaitTime":0,"scrollType":0,"scrollCount":1,"scrollWaitTime":1,"maxWaitTime":10,"paras":[],"allXPaths":["/html/body/div[2]/main[1]/div[1]/div[1]/div[2]/div[1]/ul[1]/li[1]/a[1]","//a[contains(., 'PDF')]","//A[@class='abs-button download-pdf']"]}}]}
|
||||
Loading…
x
Reference in New Issue
Block a user