Struct WebPage

pub struct WebPage {
    pub id: String,
    pub url: String,
    pub title: String,
    pub content: String,
    pub snippet: String,
    pub domain: String,
    pub indexed_at: DateTime<Utc>,
    pub last_crawled: DateTime<Utc>,
    pub status_code: u16,
    pub content_type: Option<String>,
    pub content_length: Option<usize>,
}

Represents a web page document stored in the database.

Contains all metadata and content for an indexed web page.

Fields

id: String

Unique identifier for the web page

url: String

Original URL of the web page

title: String

Title extracted from the page

content: String

Full text content of the page

snippet: String

Brief excerpt for search results

domain: String

Domain name the page belongs to

indexed_at: DateTime<Utc>

Timestamp when the page was indexed

last_crawled: DateTime<Utc>

Timestamp of the last crawl attempt

status_code: u16

HTTP status code from the last crawl

content_type: Option<String>

Content-Type header from the response

content_length: Option<usize>

Size of the content in bytes

Trait Implementations

impl Clone for WebPage

fn clone(&self) -> WebPage

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for WebPage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for WebPage

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for WebPage

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.