facebook-crawler

Facebook_Crawler

• The project is developed by TENG-LIN YU(游騰林).
• Please feel free to contact me if you have any suggestions or problems.

Support

Donate is not required to utilize this package, but it would be great to have your support. Either donate, star or share are good to me. Your support will help me keep maintaining and developing in this project

贊助不是使用這個套件的必要條件，但如能獲得你的支持我將會非常感謝。不論是贊助、給予星星或跟朋友分享對我來說都是非常好的支持方式。有你的支持我才能繼續在這個專案中維護和開發新的功能。

What's this?

The project can help us collect the data from Facebook's public Fanspage / group. Here are the three big points of this project:

• You don't need to log in to your account.
• Easy: Just key in the Fanspage/group URL and the target date(to break the while loop).
• Efficient: It collects the data through the requests package directly instead of Selenium.

這個專案可以幫我們從 Facebook 公開的的粉絲頁和公開社團收集資料。以下是本專案的 3 個重點:

• 不需登入: 不需要帳號密碼因此也不用擔心被鎖定帳號
• 簡單: 僅需要粉絲頁/社團的網址和停止的日期(用來跳脫迴圈)
• 高效: 透過 request 直接向伺服器請求資料，不需通過 Selenium

Quickstart

• Install

  pip install -U facebook-crawler
  

• Usage

  • Facebook Fanspage

    import facebook_crawler
    pageurl= 'https://www.facebook.com/diudiu333'
    facebook_crawler.Crawl_PagePosts(pageurl=pageurl, until_date='2021-01-01')
    

    
  • Group

    import facebook_crawler
    groupurl = 'https://www.facebook.com/groups/pythontw'
    facebook_crawler.Crawl_GroupPosts(groupurl, until_date='2021-01-01')
    

    

FAQ

• Could you please release the function that can collect comments content instead of only the number of comments? Please write an E-mail to me and tell me your project goal, thanks!

• How can I find out the post's link through the data?

  You can add the string 'https://www.facebook.com' in front of the POSTID, and it's just its post link. So, for example, if the POSTID is 123456789, and its link is 'https://www.facebook.com/12345679'.

• Can I directly collect the data in the specific time period?

  Nope! It's related to Facebook's website framework. You need to collect the data from the newest post to the older post.

License

• MIT License
• 本專案提供的所有內容均用於教育、非商業用途。本專案不對資料內容錯誤、更新延誤或傳輸中斷負任何責任。

Contact Info

• Author: TENG-LIN YU
• Email: [e-mail]
• Facebook: https://www.facebook.com/tlyu0419
• PYPI: https://pypi.org/project/facebook-crawler/
• Github: https://github.com/TLYu0419/facebook_crawler

Log

• 0.0.26
  • Auto changes the cookie after it's expired to keep crawling data without changing IP.