class

Fetcher::DomainBatchProcessor

Inherits Reference < Object

Domain-based feed grouping and batch processing

Class methods

group_by_domain(urls : Array(String)) : Hash(String, Array(String))
Source
process_batches(urls : Array(String), headers : HTTP::Headers = ::HTTP::Headers.new, limit : Int32 = 100, config : RequestConfig = RequestConfig.new) : Array(Result)

Process feeds in domain batches with adaptive concurrency

Source