2.0.1

🚀 Features

• Add standby URL and change default standby port
• Add crawlee version to system info output

🐛 Bug Fixes

• Allow empty timeout_at environment variable
• Use HttpHeaders type in Scrapy integration
• Adjust tests for Scrapy user data

2.0.0

2.0.0 (2024-09-10)

• Check the Upgrading to v2 guide.

🚀 Features

• Using Crawlee for Python under the hood (#210) by @janbuchar
• Better Actor API typing (#256) by @janbuchar
• Expose Request from Crawlee (#266) by @vdusek
• Improve examples in README (#269) by @vdusek
• Automatically configure logging (#271) by @janbuchar

🐛 Bug Fixes

• Make apify.log public (#249) by @janbuchar
• Dataset list response handling (#257) by @janbuchar
• Ignore deprecated platform events (#258) by @janbuchar
• Possible infinity loop in Apify-Scrapy proxy middleware (#259) by @vdusek
• Hotfix for batch_add_requests batch size limit (#261) by @janbuchar

1.7.2

Added

• Add actor standby port

1.7.1

Fixed

• Set a timeout for Actor cleanup

1.7.0

Added

• Add a new way of generating the uniqueKey field of the request, aligning it with the Crawlee.

Fixed

• Improve error handling for to_apify_request serialization failures
• Scrapy's Request.dont_filter works.

1.6.0

Fixed

• Update of Scrapy integration, fixes in ApifyScheduler, to_apify_request and apply_apify_settings

Removed

• Removed ApifyRetryMiddleware and stay with the Scrapy's default one

1.5.5

Fixed

• Fix conversion of headers fields in Apify <--> Scrapy request translation

1.5.4

Fixed

• Fix conversion of userData and headers fields in Apify <--> Scrapy request translation

1.5.3

Added

• Add apply_apify_settings function to Scrapy subpackage

1.5.2

Internal changes

• Create a new subpackage for Scrapy pipelines
• Remove some noqas thanks to the new Ruff release
• Replace relative imports with absolute imports
• Replace asserts with custom checks in Scrapy subpackage

Fixed

• Add missing import check to ApifyHttpProxyMiddleware