Scribd Logo
Upload

Welcome to Scribd!

  • Ir Equations

    Uploaded by

    karthic11
    7 views1 page
    This document discusses various terms and formulas related to information retrieval and text mining including: - Term frequency-inverse document frequency (tf-idf) which weights the importance of terms based on frequency and distribution across documents - Cosine similarity which measures similarity between two documents as the cosine of the angle between their vector representations - Recall and precision which are common information retrieval evaluation metrics - Fallout which measures false positives in retrieval - Association and correlation matrices used to represent relationships between documents - Formulas for calculating independence, regular, and Rochio models for relevance feedback in query expansion.

    Original Description:

    Ir Equations

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document discusses various terms and formulas related to information retrieval and text mining including: - Term frequency-inverse document frequency (tf-idf) which weights the importance of terms based on frequency and distribution across documents - Cosine similarity which measures similarity between two documents as the cosine of the angle between their vector representations - Recall and precision which are common information retrieval evaluation metrics - Fallout which measures false positives in retrieval - Association and correlation matrices used to represent relationships between documents - Formulas for calculating independence, regular, and Rochio models for relevance feedback in query expansion.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    7 views1 page

    Ir Equations

    Uploaded by

    karthic11
    This document discusses various terms and formulas related to information retrieval and text mining including: - Term frequency-inverse document frequency (tf-idf) which weights the importance of terms based on frequency and distribution across documents - Cosine similarity which measures similarity between two documents as the cosine of the angle between their vector representations - Recall and precision which are common information retrieval evaluation metrics - Fallout which measures false positives in retrieval - Association and correlation matrices used to represent relationships between documents - Formulas for calculating independence, regular, and Rochio models for relevance feedback in query expansion.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 1

    tfij = fij / maxi{fij} idfi = log2 (N/ df i) wij = t ij idf i = t ij log2 (N/ df i)

    t ( w ij w iq ) dj q i =1 cos Sim(dj , q ) = = t dj q 2 t 2 w ij w iq i =1 i =1

    recall =

    Number of relevant documents retrieved Total number of relevant documents Number of relevant documents retrieved Total number of documents retrieved

    precision =

    P ( r j ) = max P ( r )
    r j r r j +1

    F= E=

    2 PR 2 = 1 1 P + R R+ P (1 + 2 ) PR (1 + 2 ) = 2 1 2P + R + R P
    no. of nonrelevant items retrieved total no. of nonrelevant items in the collection

    Fallout =

    d j Dr

    d j Dr

    d j Dn

    d j Dr

    Associatio n matrix : c ij =

    d k D

    Metric correlation matrix : c ij = f 1 r

    f r = k (for constant k ) AN AN AN = n n + 1 n(n + 1)

    I n = rn rn +1 = V = Kn

    with constants K , 0 < < 1

    Ide " dec hi" : qm = q +


    max nonrelevant (d j ) f jk sij = 1 u , kv ) pr = cij cii + c jj c ij cij sij = Vi V j

    ik

    k u Vi k v V j

    r (k

    In 1 = D n(n + 1)

    Ide regular : q m = q +

    Rochio : q m = q +

    d j Dn

    Dr

    Dn

    f A = for corpus indp. const. A 0.1 N r

    You might also like