spider/Douyin_TikTok_Download_API
1
0
Fork 0
mirror of https://github.com/Evil0ctal/Douyin_TikTok_Download_API.git synced 2025-04-20 22:40:08 +08:00
Code Issues Packages Projects Releases Wiki Activity

docs: Added README."en".md translation via https://github.com/dephraiim/translate-readme

Browse Source
This commit is contained in:
github-actions[bot] 2022-11-15 02:40:40 +00:00
parent 269ecc17ee
commit 5d56be9e66
1 changed files with 102 additions and 173 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

275
README.en.md
View File

@ -17,17 +17,19 @@
Language: \[[English](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.en.md)] \[[Simplified Chinese](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md)] Language: \[[English](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.en.md)] \[[Simplified Chinese](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md)]
## 👻 Introduction ## 👻Introduction
This project is based on[PyWebIO](https://github.com/pywebio/PyWebIO)，[FastAPI](https://fastapi.tiangolo.com/)，[AIOHTTP](https://docs.aiohttp.org/), fast asynchronous[Tik Tok](https://www.douyin.com/)/[TikTok](https://www.tiktok.com/)It is a data crawling tool, and realizes online batch analysis and download of video or atlas without watermark through the web terminal, data crawling API, iOS shortcut command without watermark download and other functions. You can deploy or transform this project yourself to achieve more functions, or you can call it directly in your project[scraper.py](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/Stable/scraper.py)or install an existing[pip package](https://pypi.org/project/douyin-tiktok-scraper/)As a parsing library, it is easy to crawl data, etc... > 🚨If you need to use a private server to run this project, please refer to the deployment method\[[Docker deployment](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md#%E9%83%A8%E7%BD%B2%E6%96%B9%E5%BC%8F%E4%BA%8C-docker),[Manual deployment](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md#%E9%83%A8%E7%BD%B2%E6%96%B9%E5%BC%8F%E4%B8%80-%E6%89%8B%E5%8A%A8%E9%83%A8%E7%BD%B2)]
This project is based on[PyWebIO](https://github.com/pywebio/PyWebIO)，[FastAPI](https://fastapi.tiangolo.com/)，[AIOHTTP](https://docs.aiohttp.org/), fast asynchronous[Tik Tok](https://www.douyin.com/)/[TikTok](https://www.tiktok.com/)Data crawling tool, and realize online batch parsing and download of watermark-free videos or atlases through the web terminal, data crawling API, iOS shortcut command without watermark download and other functions. You can deploy or transform this project yourself to achieve more functions, or you can call it directly in your project[scraper.py](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/Stable/scraper.py)or install an existing[pip package](https://pypi.org/project/douyin-tiktok-scraper/)As a parsing library to easily crawl data, etc...
_Some simple application scenarios:_ _Some simple application scenarios:_
_Download prohibited videos for data analysis, download without watermark for iOS (with[iOS built-in shortcut command APP](https://apps.apple.com/cn/app/%E5%BF%AB%E6%8D%B7%E6%8C%87%E4%BB%A4/id915249334)Cooperate with the API of this project to realize in-app download or read clipboard download), etc....._ _Download prohibited videos, perform data analysis, and download without watermark on iOS (with[Shortcut APP that comes with iOS](https://apps.apple.com/cn/app/%E5%BF%AB%E6%8D%B7%E6%8C%87%E4%BB%A4/id915249334)Cooperate with the API of this project to realize in-app download or read clipboard download), etc..._
## 🖥Public Site: I'm fragile...please don't hit me ‎(••᷄ࡇ•᷅ ） ## 🖥Public Site: I'm vulnerable...please don't hit me at will ‎(·•᷄ࡇ•᷅ ）
> **API-V2:**support input`Douyin|TikTok`Crawl the author's homepage \[homepage video data (remove the watermark link, the list of liked videos (permissions must be public), video comment data, background music video list data, etc...), please refer to the V2 document for details , the server response time sometimes becomes longer, please set the`timeout`Set the value high. > **API-V2:**support input`Douyin|TikTok`The user's homepage crawls the author \[homepage video data (remove watermark link, liked video list (permission must be public), video comment data, background music video list data, etc...), please check the V2 document for details , the server response time may sometimes become longer, please`timeout`Set the value high.
🍔Web APP:<https://douyin.wtf/> 🍔Web APP:<https://douyin.wtf/>
@ -37,7 +39,7 @@ _Download prohibited videos for data analysis, download without watermark for iO
💾iOS Shortcut:[Shortcut release](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/discussions/104?sort=top) 💾iOS Shortcut:[Shortcut release](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/discussions/104?sort=top)
📦️Desktop downloader (recommended by warehouse): 📦️ Desktop downloader (recommended warehouse):
- [Tairraos/TikToon](https://github.com/Tairraos/TikDown/) - [Tairraos/TikToon](https://github.com/Tairraos/TikDown/)
- [Johnserf-Seed/TikTokDownload](https://github.com/Johnserf-Seed/TikTokDownload) - [Johnserf-Seed/TikTokDownload](https://github.com/Johnserf-Seed/TikTokDownload)
@ -55,13 +57,13 @@ _Download prohibited videos for data analysis, download without watermark for iO
> **_web_api.py:_** > **_web_api.py:_**
- Get request parameters and use`Scraper()`After the class processes the data, it returns in the form of JSON, video downloads, quick calls with iOS shortcut commands, and asynchronous support. - get request parameters and use`Scraper()`After the class processes the data, it returns it in the form of JSON, and the video is downloaded. It can be called quickly with the iOS shortcut command, and supports asynchronous.
> **_web_app.py:_** > **_web_app.py:_**
- for`web_api.py`as well as`scraper.py`A simple web program made to process the value entered in the web page and then use it`Scraper()`class processing and matching`web_api.py`The interface output is on the web page (similar to the separation of front and back ends) - for`web_api.py`as well as`scraper.py`Created a simple web program that processes the value entered on the web page and uses it`Scraper()`Class handling and coordination`web_api.py`The interface output is on the web page (similar to front-end and back-end separation)
**_Most of the parameters of the above files can be found in[config. ini](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/config.ini)make changes in_** **_Most of the parameters of the above files can be found in[config.ini](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/config.ini)make changes in_**
## 💡Project file structure ## 💡Project file structure
@ -73,73 +75,34 @@ _Download prohibited videos for data analysis, download without watermark for iO
├── scraper.py -> (Parsing library) ├── scraper.py -> (Parsing library)
├── config.ini -> (configuration file) ├── config.ini -> (configuration file)
## 💯 Supported functions: ## 💯 Supported features:
- Douyin (overseas version of Douyin: TikTok) video/picture analysis - Douyin (Douyin overseas version: TikTok) video/picture analysis
- Batch analysis on the web page (supports Douyin/TikTok mixed submission) - Batch parsing on the webpage (support Douyin/TikTok mixed submission)
- Batch download of non-watermarked videos from the analysis result page on the web page (temporarily removed in V3.0.0) - Batch download of watermark-free videos on the web-side parsing result page (Temporarily removed for V3.0.0)
- API call to get link data - API call to get link data
- make[pip package](https://pypi.org/project/douyin-tiktok-scraper/)Easily and quickly import your projects - make[pip package](https://pypi.org/project/douyin-tiktok-scraper/)Easily and quickly import your projects
- [\[iOS shortcut command to quickly call API\]](https://apps.apple.com/cn/app/%E5%BF%AB%E6%8D%B7%E6%8C%87%E4%BB%A4/id915249334)Realize in-app download without watermark video/photo gallery - [iOS shortcut command to quickly call API](https://apps.apple.com/cn/app/%E5%BF%AB%E6%8D%B7%E6%8C%87%E4%BB%A4/id915249334)Realize in-app download of video/atlas without watermark
- Parse all videos on the author's homepage ([API-V2](https://api-v2.douyin.wtf/docs)Support Douyin/TikTok) - Parse all videos in the author's homepage ([API-V2](https://api-v2.douyin.wtf/docs)Support Douyin/TikTok)
- Parse all comment information in the video ([API-V2](https://api-v2.douyin.wtf/docs)Support Douyin/TikTok) - Parse all comments in the video ([API-V2](https://api-v2.douyin.wtf/docs)Support Douyin/TikTok)
* * * * * *
## 🤦‍Following features: ## 🤦‍Follow-up features:
- [ ] Welcome to make new suggestions or share your ideas with me in issue - [ ] Welcome to make new suggestions or share your ideas with me in the issue
- [ ] Welcome to submit PR to[Development branch](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/tree/Development)♪(･ω･)ﾉ) - [ ] Welcome to submit PR to[Development branch](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/tree/Development)♪(･ω･)ﾉ)
* * * * * *
## 🧭Running instructions (Python version > 3.0): ## 📦 Call parsing library:
> 🚨If you want to deploy this project, please refer to the deployment method ([Docker deployment](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md#%E9%83%A8%E7%BD%B2%E6%96%B9%E5%BC%8F%E4%BA%8C-docker "Docker部署"),[manual deployment](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/README.md#%E9%83%A8%E7%BD%B2%E6%96%B9%E5%BC%8F%E4%B8%80-%E6%89%8B%E5%8A%A8%E9%83%A8%E7%BD%B2 "手动部署")) > 💡PyPi:<https://pypi.org/project/douyin-tiktok-scraper/>
- Clone the repository: Install the parsing library:`pip install douyin-tiktok-scraper`
```console
git clone https://github.com/Evil0ctal/Douyin_TikTok_Download_API.git
```
- Move to the repository directory:
```console
cd Douyin_TikTok_Download_API
```
- Install dependent libraries:
```console
pip install -r requirements.txt
```
- Modify config.ini (optional):
```console
vim config.ini
```
- web page analysis
```console
# 运行web_app.py
python3 web_app.py
```
- API
```console
# 运行web_api.py
python3 web_api.py
```
- call parsing library
```python ```python
import asyncio import asyncio
# pip install douyin-tiktok-scraper
from douyin_tiktok_scraper.scraper import Scraper from douyin_tiktok_scraper.scraper import Scraper
api = Scraper() api = Scraper()
@ -147,90 +110,77 @@ api = Scraper()
async def async_test(url: str) -> dict: async def async_test(url: str) -> dict:
# Hybrid parsing(Douyin/TikTok URL) # Hybrid parsing(Douyin/TikTok URL)
hybrid_data = await api.hybrid_parsing(url) hybrid_data = await api.hybrid_parsing(url)
print(f"The hybrid parsing data is: {hybrid_data}") print(f"The hybrid parsing result:\n {hybrid_data}")
return hybrid_data return hybrid_data
asyncio.run(async_test(url=input("Paste Douyin/TikTok share URL here: "))) asyncio.run(async_test(url=input("Paste Douyin/TikTok share URL here: ")))
``` ```
- Entry (port can be modified in config.ini file) ## 🗺️ Supported submission formats:
> 💡Tip: Including but not limited to the following examples, if you encounter link resolution failure, please open a new one[issue](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/issues)
- Douyin share password (copy in APP)
```text ```text
Web入口: 7.43 pda:/ 让你在几秒钟之内记住我 https://v.douyin.com/L5pbfdP/ 复制此链接，打开Dou音搜索，直接观看视频！
http://localhost(服务器IP):8080/
API入口:
http://localhost(服务器IP):8000/
``` ```
## 🗺️Supported submission formats (including but not limited to the following examples): - Douyin Short URL (Copy in APP)
- Douyin sharing password (copy in APP)
```text ```text
例子：7.43 pda:/ 让你在几秒钟之内记住我 https://v.douyin.com/L5pbfdP/ 复制此链接，打开Dou音搜索，直接观看视频！ https://v.douyin.com/L4FJNR3/
```
- Douyin short URL (copy in APP)
```text
例子：https://v.douyin.com/L4FJNR3/
``` ```
- Douyin normal URL (web version copy) - Douyin normal URL (web version copy)
```text ```text
例子：
https://www.douyin.com/video/6914948781100338440 https://www.douyin.com/video/6914948781100338440
``` ```
- Douyin Discovery Page URL (APP Copy) - Douyin discovery page URL (APP copy)
```text ```text
例子：
https://www.douyin.com/discover?modal_id=7069543727328398622 https://www.douyin.com/discover?modal_id=7069543727328398622
``` ```
- TikTok short URL (copy in APP) - TikTok Short URL (In-App Copy)
```text ```text
例子： https://www.tiktok.com/t/ZTR9nDNWq/
https://vm.tiktok.com/TTPdkQvKjP/
``` ```
- TikTok normal URL (web version copy) - TikTok normal URL (copy from web version)
```text ```text
例子： https://www.tiktok.com/@evil0ctal/video/7156033831819037994
https://www.tiktok.com/@tvamii/video/7045537727743380782
``` ```
- Douyin/TikTok bulk URLs (no need to use symbols to separate) - Douyin/TikTok bulk URLs (no need to separate them)
```text ```text
例子： https://v.douyin.com/L4NpDJ6/
2.84 nqe:/ 骑白马的也可以是公主%%百万转场变身 https://v.douyin.com/L4FJNR3/ 复制此链接，打开Dou音搜索，直接观看视频！ https://www.douyin.com/video/7126745726494821640
8.94 mDu:/ 让你在几秒钟之内记住我 https://v.douyin.com/L4NpDJ6/ 复制此链接，打开Dou音搜索，直接观看视频！ 2.84 nqe:/ 骑白马的也可以是公主%%百万转场变身https://v.douyin.com/L4FJNR3/ 复制此链接，打开Dou音搜索，直接观看视频！
9.94 LWz:/ ok我坦白交代 %%knowknow https://v.douyin.com/L4NEvNn/ 复制此链接，打开Dou音搜索，直接观看视频！
https://www.tiktok.com/@gamer/video/7054061777033628934 https://www.tiktok.com/t/ZTR9nkkmL/
https://www.tiktok.com/@off.anime_rei/video/7059609659690339586 https://www.tiktok.com/t/ZTR9nDNWq/
https://www.tiktok.com/@tvamii/video/7045537727743380782 https://www.tiktok.com/@evil0ctal/video/7156033831819037994
``` ```
## 🛰️API Documentation ## 🛰️API Documentation
> You can also see the interface documentation in the code of web_api.py > 💡Tip: You can also view the interface documentation in the code comments of web_api.py
**_API-V1 documentation:_**[http://localhost(server IP):8000/docs](http://localhost:8000/docs)or<https://api.douyin.wtf/docs> **_API-V1 Documentation:_**local:<http://localhost:8000/docs>Online:<https://api.douyin.wtf/docs>
**_API-V2 documentation:_**<https://api-v2.douyin.wtf/docs> **_API-V2 Documentation:_**Online:<https://api-v2.douyin.wtf/docs>
**_API demo:_** **_API demo:_**
- Crawl video data (TikTok or Douyin hybrid analysis)`https://api.douyin.wtf/api?url=[视频链接/Video URL]&minimal=false` - Crawl video data (TikTok or Douyin mixed analysis)`https://api.douyin.wtf/api?url=[视频链接/Video URL]&minimal=false`
- Download video/photo gallery (TikTok or Douyin mixed analysis)`https://api.douyin.wtf/download?url=[视频链接/Video URL]&prefix=true&watermark=false`
- Download video/photo gallery (TikTok or Douyin hybrid analysis)`https://api.douyin.wtf/download?url=[视频链接/Video URL]&prefix=true&watermark=false` - Replace the domain name to download videos/atlas
- Replace domain name to download video/photo gallery
[抖音] [抖音]
@ -238,57 +188,55 @@ https://www.tiktok.com/@tvamii/video/7045537727743380782
https://www.douyin.com/video/7159502929156705567 https://www.douyin.com/video/7159502929156705567
替换域名: 替换域名:
https://api.douyin.wtf/video/7159502929156705567 https://api.douyin.wtf/video/7159502929156705567
# 返回无水印视频下载 # 返回无水印视频下载响应
[TikTok] [TikTok]
original link: original link:
https://www.tiktok.com/@evil0ctal/video/7156033831819037994 https://www.tiktok.com/@evil0ctal/video/7156033831819037994
Replace Domain: Replace Domain:
https://api.douyin.wtf/@evil0ctal/video/7156033831819037994 https://api.douyin.wtf/@evil0ctal/video/7156033831819037994
# Return No Watermark Video Download # Return No Watermark Video Download Response
**_For more demos, please check the content of the document..._** **_Check out the documentation for more demos..._**
* * * ## 💻Deployment (Method 1 Linux)
## 💾Deployment (method 1 manual deployment) > 💡Tip: It is best to deploy this project to a server in the United States, otherwise strange bugs may occur.
> Note: - First go to the security group to open ports 8080 (Web) and 8000 (API).
> The screenshots may not match the text due to update issues, please refer to the text description first. - Search in the Pagoda Panel App Store`进程守护`or install manually`supervisord`：
> It is best to deploy this project to an overseas server (a server in the United States is preferred), otherwise strange problems may occur.
example: [宝塔面板]
The project is deployed on a domestic server, but the person is in the United States. Clicking on the link on the result page reports an error 403, which is related to the Douyin CDN by visual inspection. https://www.bt.cn/new/download.html
The project is deployed on the South Korean server, and TikTok reports an error, visually checking that TikTok has restricted certain regions or IPs. [aapanel]
https://www.aapanel.com/new/download.html
[Supervisor]
http://supervisord.org/installing.html
> Deploy using Pagoda Linux panel ( - configuration item[config.ini](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/config.ini)document
> The Chinese Pagoda has to be bound to a mobile phone number. It is very rogue and cannot be bypassed. It is recommended to use the international version of Pagoda. Google the keyword aapanel to install it yourself. The deployment steps are similar. ) - Install dependencies`pip install -r requirements.txt`
- set up`supervisord`daemon
- Start command:
- First of all, go to the security group to open ports 8080 and 8000 (Web defaults to 8080, API defaults to 8000, which can be modified in the file config.ini.) ```console
- Search for python in the Pagoda app store and install the project manager (version 1.9 is recommended) [Web]
python3 web_app.py
[API]
python3 web_api.py
```
![](https://raw.githubusercontent.com/Evil0ctal/TikTokDownloader_PyWebIO/main/Screenshots/BT_Linux_Panel_Deploy_1.png) - Program entry:
* * * ```text
[Web]
http://localhost:8080
[API]
http://localhost:8000
```
- Create a project with an arbitrary name ## 💽Deployment (Method 2 Docker)
- Path select the path of your uploaded file
- The Python version needs to be at least 3 or more (install it yourself in the version management on the left)
- The framework is modified to`Uvicorn`
- The startup method is changed to`python`
- Web startup file selection`web_app.py`
- API startup file selection`web_api.py`
- Check the install module dependencies
- Start up at will
- Please judge whether the port is occupied by yourself. The running port can be modified in the file config.ini.
- If there are a lot of requests use_process daemon_start prevents process from shutting down
![](https://raw.githubusercontent.com/Evil0ctal/TikTokDownloader_PyWebIO/main/Screenshots/BT_Linux_Panel_Deploy_2.png) > 💡Docker Image repo:[Docker Hub](https://hub.docker.com/repository/docker/evil0ctal/douyin_tiktok_download_api)
* * *
## 💾 Deployment (Method 2 Docker)
- install docker - install docker
@ -325,52 +273,33 @@ docker compose pull && docker compose down && docker compose up -d
[![](https://github.com/Evil0ctal.png?size=50)](https://github.com/Evil0ctal)[![](https://github.com/jw-star.png?size=50)](https://github.com/jw-star)[![](https://github.com/Jeffrey-deng.png?size=50)](https://github.com/Jeffrey-deng)[![](https://github.com/chris-ss.png?size=50)](https://github.com/chris-ss)[![](https://github.com/weixuan00.png?size=50)](https://github.com/weixuan00)[![](https://github.com/Tairraos.png?size=50)](https://github.com/Tairraos) [![](https://github.com/Evil0ctal.png?size=50)](https://github.com/Evil0ctal)[![](https://github.com/jw-star.png?size=50)](https://github.com/jw-star)[![](https://github.com/Jeffrey-deng.png?size=50)](https://github.com/Jeffrey-deng)[![](https://github.com/chris-ss.png?size=50)](https://github.com/chris-ss)[![](https://github.com/weixuan00.png?size=50)](https://github.com/weixuan00)[![](https://github.com/Tairraos.png?size=50)](https://github.com/Tairraos)
## 🎉Screenshot ## 📸 Screenshot
> Note: **_API speed test (compared to official API)_**
> The screenshots may not match the text due to update issues, please refer to the text description first.
<details><summary>点击展开截图</summary> <details><summary>🔎点击展开截图</summary>
<hr> Douyin official API:![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/benchmarks/Douyin_API.png?raw=true)
- Main interface API of this project:![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/benchmarks/Douyin_API_Douyin_wtf.png?raw=true)
![](https://github.com/Evil0ctal/TikTokDownloader_PyWebIO/blob/main/Screenshots/home.png) TikTok official API:![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/benchmarks/TikTok_API.png?raw=true)
* * * API of this project:![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/benchmarks/TikTok_API_Douyin_wtf.png?raw=true)
- Parsing complete
> single
![](https://github.com/Evil0ctal/TikTokDownloader_PyWebIO/blob/main/Screenshots/single_result.png)
* * *
> batch
![](https://github.com/Evil0ctal/TikTokDownloader_PyWebIO/blob/main/Screenshots/multi_results.png)
* * *
- API submit/return
> video return value
![](https://github.com/Evil0ctal/TikTokDownloader_PyWebIO/blob/main/Screenshots/api_video_result.png)
> Atlas return value
![](https://github.com/Evil0ctal/TikTokDownloader_PyWebIO/blob/main/Screenshots/api_image_result.png)
> TikTok return value
![](https://raw.githubusercontent.com/Evil0ctal/TikTokDownloader_PyWebIO/main/Screenshots/tiktok_API.png)
* * *
</details> </details>
<hr>
**_Project interface_**
<details><summary>🔎点击展开截图</summary>
Web主界面:
![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/v3_screenshots/Home.png?raw=true)
Web main interface:![](https://github.com/Evil0ctal/Douyin_TikTok_Download_API/blob/main/Screenshots/v3_screenshots/Home_en.png?raw=true)
</details>
<hr>
## 📜 Star History ## 📜 Star History