Struct CrawlQueue

pub struct CrawlQueue {
    pub id: String,
    pub url: String,
    pub domain: String,
    pub depth: usize,
    pub status: CrawlStatus,
    pub created_at: DateTime<Utc>,
    pub processed_at: Option<DateTime<Utc>>,
    pub error_message: Option<String>,
    pub retry_count: usize,
}

Represents a crawl queue entry for managing web crawling operations.

Used to track URLs that need to be crawled and their crawling metadata.

Fields

id: String

Unique identifier for the queue entry

url: String

URL to be crawled

domain: String

Domain name for organization

depth: usize

Crawl depth from the starting URL

status: CrawlStatus

created_at: DateTime<Utc>

processed_at: Option<DateTime<Utc>>

error_message: Option<String>

retry_count: usize

Trait Implementations

impl Clone for CrawlQueue

fn clone(&self) -> CrawlQueue

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlQueue

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CrawlQueue

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CrawlQueue

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.