Scribd Logo
Upload

Welcome to Scribd!

  • Test Algo

    Uploaded by

    Rohit Chandekar
    10 views6 pages
    1. The document is a log file from a Jigsaw production recommendation system that provides details on initializing the system and processing customer data. 2. It extracts customer purchase and viewing histories from different data sources and partitions the data. 3. It then analyzes the data to generate recommendations by running a custom grep predictor model and building a graph of related products.

    Original Description:

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    1. The document is a log file from a Jigsaw production recommendation system that provides details on initializing the system and processing customer data. 2. It extracts customer purchase and viewing histories from different data sources and partitions the data. 3. It then analyzes the data to generate recommendations by running a custom grep predictor model and building a graph of related products.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    10 views6 pages

    Test Algo

    Uploaded by

    Rohit Chandekar
    1. The document is a log file from a Jigsaw production recommendation system that provides details on initializing the system and processing customer data. 2. It extracts customer purchase and viewing histories from different data sources and partitions the data. 3. It then analyzes the data to generate recommendations by running a custom grep predictor model and building a graph of related products.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 6

    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    Initializing Production Jigsaw App Context mode for logs and metrics.
    +----------+-----------+--------------+-------------------+----------------------+-------
    ----------+
    |customerId|partitionBy|partitionScore|campaignPartitionBy|campaignPartitionScore|recomme
    ndedEntity|
    +----------+-----------+--------------+-------------------+----------------------+-------
    ----------+
    +----------+-----------+--------------+-------------------+----------------------+-------
    ----------+

    (Recs at initial stage: ,())


    (Current element type: ,EntitySelector)
    (Loan data partition for current element:
    ,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@74cebf84)
    (DataProviderId: ,CustomerAsinSubCatGlPurchasesDataProvider)
    root
    |-- asin: string (nullable = true)
    |-- subCatId: string (nullable = true)
    |-- customerId: double (nullable = true)
    |-- numberOfPurchases: double (nullable = true)
    |-- customerHash: long (nullable = true)
    |-- purchasedDate: date (nullable = true)
    |-- gl: long (nullable = true)
    |-- catId: string (nullable = true)
    |-- purchasedDateOffset: integer (nullable = true)

    (dataframeResult: ,())
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    | asin|subCatId| customerId|numberOfPurchases|customerHash|purchasedDate| gl|
    catId|purchasedDateOffset|
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    |0553250426| 1402805|7.070181525E9| 1.0| 15| 2022-09-15|
    14|1402800| -14|
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    only showing top 1 row

    (dataframeResult: ,())
    (DataProviderId: ,CustomerAsinSubCatGlViewsDataProvider)
    root
    |-- asin: string (nullable = true)
    |-- subCatId: string (nullable = true)
    |-- customerId: double (nullable = true)
    |-- numberOfViews: long (nullable = true)
    |-- customerHash: long (nullable = true)
    |-- viewedDate: date (nullable = true)
    |-- gl: long (nullable = true)
    |-- catId: string (nullable = true)
    |-- viewedDateOffset: integer (nullable = true)

    (dataframeResult: ,())
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+
    | asin|subCatId| customerId|numberOfViews|customerHash|viewedDate| gl|
    catId|viewedDateOffset|
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+

    1 of 6 29/09/22, 8:11 pm
    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    |0143333402| 1404405|1.1682994835E10| 1| 48|2022-09-19| 14|1404400|


    -10|
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+
    only showing top 1 row

    (dataframeResult: ,())
    Map(PurchasesLoanedPartitionKey ->
    com.amazon.cba.jigsaw.core.recs.engine.data.DataPartition@5a6c5c10,
    ViewsLoanedPartitionKey ->
    com.amazon.cba.jigsaw.core.recs.engine.data.DataPartition@31e5c69d)
    (Loaned data partitions for current
    element:,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@74cebf84)
    Inside CustomGrepPredictor
    (Model Id: ,aV2w_aP2w__cs_e10_30d_model)
    +----------+
    |customerId|
    +----------+
    +----------+

    (Customers to select in grepPredictor ,())


    (numberOfCustomersToSelect: ,0)
    +----------+
    |customerId|
    +----------+
    +----------+

    (CustomerToSelect: ,())
    (Start offset: ,-30)
    (End offset: ,0)
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+
    | asin|subCatId| customerId|numberOfViews|customerHash|viewedDate| gl|
    catId|viewedDateOffset|
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+
    |0143333402| 1404405|1.1682994835E10| 1| 48|2022-09-19| 14|1404400|
    -10|
    +----------+--------+---------------+-------------+------------+----------+---+-------+--
    --------------+
    only showing top 1 row

    (Purchase data: ,())


    +------------+------------+-----------+-----------+--------------------+-----------------
    ---+--------------------+--------------------+------------------+-------------------+----
    ----------------+-------------------+--------------+--------------+--------+
    |sourceEntity|targetEntity|sourceCount|targetCount|sourceAndTargetCount|
    recall| precision| liftByN| lift|sourceRankByLiftByN|
    ig| igPositive|sourceRankByIg|targetRankByIg|edgeRank|
    +------------+------------+-----------+-----------+--------------------+-----------------
    ---+--------------------+--------------------+------------------+-------------------+----
    ----------------+-------------------+--------------+--------------+--------+
    | 8184517580| 8184517580| 973| 137| 14|
    0.10218978102189781|0.014388489208633094|1.050254686761539...| 37794.40907420049|
    1|3.734829801316115...|0.07531075903304427| 1| 1| 1|
    | B00DRE2S0G| B00DRE2S0G| 27829| 8215| 939|
    0.11430310407790627|0.033741780157389774|4.107337815872158E-6| 1478.064393101361|
    2|1.663616626905315...|0.14751752871987975| 1| 1| 1|
    | B01GNUJQUA| B00DRE2S0G| 1233| 8215|
    50|0.006086427267194157| 0.040551500405515|4.936275155875228E-6|1776.3653416223265|

    2 of 6 29/09/22, 8:11 pm
    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    2|9.040287835230133E-7|0.16969290271192028| 1| 9| 2|
    +------------+------------+-----------+-----------+--------------------+-----------------
    ---+--------------------+--------------------+------------------+-------------------+----
    ----------------+-------------------+--------------+--------------+--------+
    only showing top 3 rows

    (Graph record,())
    +----------------+----------+---------------+---+--------+--------+------------+---------
    ---+-----------+-----------+--------------------+--------------------+-------------------
    -+--------------------+------------------+-------------------+--------------------+------
    --------------+--------------+--------------+--------+
    | customerId| entity|numberOfActions| gl|subCatId|
    catId|sourceEntity|targetEntity|sourceCount|targetCount|sourceAndTargetCount|
    recall| precision| liftByN| lift|sourceRankByLiftByN|
    ig| igPositive|sourceRankByIg|targetRankByIg|edgeRank|
    +----------------+----------+---------------+---+--------+--------+------------+---------
    ---+-----------+-----------+--------------------+--------------------+-------------------
    -+--------------------+------------------+-------------------+--------------------+------
    --------------+--------------+--------------+--------+
    | 1.0745786025E10|B000BGK968| 1|121|12107040|12107000| B000BGK968|
    B01N0OHGDE| 3912| 3489|
    12|0.003439380911435...|0.003067484662576687|8.791873495490648E-7| 316.3838901226818|
    2|1.588404568002863...|0.020813994074791422| 2| 31| 5|
    | 1.0745786025E10|B000BGK968| 1|121|12107040|12107000| B000BGK968|
    B000BGK968| 3912| 326| 45|
    0.13803680981595093|0.011503067484662576|3.528548308178705E-5|12697.815099363921|
    1|1.066348680335901E-6| 0.06279947653173192| 1| 1| 1|
    |2.00067138812E11|B000BGK968| 1|121|12107040|12107000| B000BGK968|
    B01N0OHGDE| 3912| 3489|
    12|0.003439380911435...|0.003067484662576687|8.791873495490648E-7| 316.3838901226818|
    2|1.588404568002863...|0.020813994074791422| 2| 31| 5|
    |2.00067138812E11|B000BGK968| 1|121|12107040|12107000| B000BGK968|
    B000BGK968| 3912| 326| 45|
    0.13803680981595093|0.011503067484662576|3.528548308178705E-5|12697.815099363921|
    1|1.066348680335901E-6| 0.06279947653173192| 1| 1| 1|
    +----------------+----------+---------------+---+--------+--------+------------+---------
    ---+-----------+-----------+--------------------+--------------------+-------------------
    -+--------------------+------------------+-------------------+--------------------+------
    --------------+--------------+--------------+--------+
    only showing top 4 rows

    (Predictions: ,())
    %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
    (DataProviderId: ,AsinSubCatGlInfoDataProvider)
    root
    |-- asin: string (nullable = true)
    |-- subCatId: string (nullable = true)
    |-- catId: string (nullable = true)
    |-- gl: long (nullable = true)
    |-- parentAsin: string (nullable = true)
    |-- subCatName: string (nullable = true)
    |-- catName: string (nullable = true)
    |-- glName: string (nullable = true)

    (dataframeResult: ,())
    +----------+--------+-------+---+----------+--------------------+------------+------+
    | asin|subCatId| catId| gl|parentAsin| subCatName| catName|glName|
    +----------+--------+-------+---+----------+--------------------+------------+------+
    |0000022225| 1402828|1402800| 14|0000022225|2828 English Book...|2800 Fiction| Books|
    +----------+--------+-------+---+----------+--------------------+------------+------+

    3 of 6 29/09/22, 8:11 pm
    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    only showing top 1 row

    (dataframeResult: ,())
    Map(AsinSubCatGlInfoDataProvider ->
    com.amazon.cba.jigsaw.core.recs.engine.data.DataPartition@553028de)
    +----------+--------+-------+---+----------+--------------------+-------------------+----
    --+
    | asin|subCatId| catId| gl|parentAsin| subCatName|
    catName|glName|
    +----------+--------+-------+---+----------+--------------------+-------------------+----
    --+
    |0000022225| 1402828|1402800| 14|0000022225|2828 English Book...| 2800 Fiction|
    Books|
    |0000469025| 1401003|1401000| 14|0000469025|1003 Design & Dec...| 1000 Art|
    Books|
    |000200626X| 1403499|1403400| 14|000200626X| 3499 other|3400 social science|
    Books|
    |0002165279| 1401899|1401800| 14|0002165279| 1899 other| 1800 biography|
    Books|
    |0002171503| 1403199|1403100| 14|0002171503| 3199 Others| 3100 History|
    Books|
    +----------+--------+-------+---+----------+--------------------+-------------------+----
    --+
    only showing top 5 rows

    (Asin2SubCatMapping ,())
    +---------------+------------+------------+--------------------+-------------------+-----
    ---------------+-------------------+----------+--------------------+------------------+--
    ---------+-------------------+-----------+--------------------+--------------+-----------
    ---+--------+----------+--------+--------+---+----------+------------+-------------------
    -+--------------------+
    | customerId|targetEntity|sourceEntity| precision| recall|
    liftByN|sourceRankByLiftByN| entity| ig|
    lift|sourceCount|
    igPositive|targetCount|sourceAndTargetCount|sourceRankByIg|targetRankByIg|edgeRank|
    asin|subCatId| catId| gl|parentAsin| subCatName| catName|
    glName|
    +---------------+------------+------------+--------------------+-------------------+-----
    ---------------+-------------------+----------+--------------------+------------------+--
    ---------+-------------------+-----------+--------------------+--------------+-----------
    ---+--------+----------+--------+--------+---+----------+------------+-------------------
    -+--------------------+
    | 7.599509025E9| B000BGK968|
    B000BGK968|0.011503067484662576|0.13803680981595093|3.528548308178705E-5|
    1|B000BGK968|1.066348680335901E-6|12697.815099363921| 3912|0.06279947653173192|
    326| 45| 1| 1|
    1|B000BGK968|12107040|12107000|121|B000BGK968|7040 Laundry|7000 Household Co...|Health &
    Personal...|
    |9.5799956512E10| B000BGK968|
    B000BGK968|0.011503067484662576|0.13803680981595093|3.528548308178705E-5|
    1|B000BGK968|1.066348680335901E-6|12697.815099363921| 3912|0.06279947653173192|
    326| 45| 1| 1|
    1|B000BGK968|12107040|12107000|121|B000BGK968|7040 Laundry|7000 Household Co...|Health &
    Personal...|
    +---------------+------------+------------+--------------------+-------------------+-----
    ---------------+-------------------+----------+--------------------+------------------+--
    ---------+-------------------+-----------+--------------------+--------------+-----------
    ---+--------+----------+--------+--------+---+----------+------------+-------------------
    -+--------------------+
    only showing top 2 rows

    4 of 6 29/09/22, 8:11 pm
    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    (predictionsResult: ,())
    (Current element type: ,EntityFilter)
    (Loan data partition for current element:
    ,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@5184b817)
    Map()
    (Loaned data partitions for current
    element:,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@5184b817)
    Inside entity filter
    (Current element type: ,JourneyFilter)
    (Loan data partition for current element:
    ,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@45db479e)
    (DataProviderId: ,CustomerAsinSubCatGlPurchasesDataProvider)
    root
    |-- asin: string (nullable = true)
    |-- subCatId: string (nullable = true)
    |-- customerId: double (nullable = true)
    |-- numberOfPurchases: double (nullable = true)
    |-- customerHash: long (nullable = true)
    |-- purchasedDate: date (nullable = true)
    |-- gl: long (nullable = true)
    |-- catId: string (nullable = true)
    |-- purchasedDateOffset: integer (nullable = true)

    (dataframeResult: ,())
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    | asin|subCatId| customerId|numberOfPurchases|customerHash|purchasedDate| gl|
    catId|purchasedDateOffset|
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    |0553250426| 1402805|7.070181525E9| 1.0| 15| 2022-09-15|
    14|1402800| -14|
    +----------+--------+-------------+-----------------+------------+-------------+---+-----
    --+-------------------+
    only showing top 1 row

    (dataframeResult: ,())
    Map(PurchasesLoanedPartitionKey ->
    com.amazon.cba.jigsaw.core.recs.engine.data.DataPartition@6d6e05f6)
    (Loaned data partitions for current
    element:,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@45db479e)
    Inside customer purchase journey filter
    (Current element type: ,RecommendationPartitioner)
    (Loan data partition for current element:
    ,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@6d9563c6)
    Map()
    (Loaned data partitions for current
    element:,com.amazon.cba.jigsaw.core.recs.engine.data.LoanedDataPartitionsConfig@6d9563c6)
    Inside recs partitioner
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    |customerId|partitionBy|partitionScore|campaignPartitionBy|campaignPartitionScore|
    recommendedEntity|
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    | 3418711.0| 50400100| null| null|
    null|[subCategory -> [...|
    | 3418711.0| 50400100| null| null|
    null|[subCategory -> [...|

    5 of 6 29/09/22, 8:11 pm
    Firefox https://grep-emr-logs.s3.amazonaws.com/rohitjc/j-1BYDAPS6XCFF/co...

    | 3418711.0| 50400100| null| null|


    null|[subCategory -> [...|
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    only showing top 3 rows

    ()
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    |customerId|partitionBy|partitionScore|campaignPartitionBy|campaignPartitionScore|
    recommendedEntity|
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    | 3418711.0| 50400100| -1.0| null|
    null|[subCategory -> [...|
    | 3418711.0| 50400100| -2.0| null|
    null|[subCategory -> [...|
    | 3418711.0| 50400100| -3.0| null|
    null|[subCategory -> [...|
    | 3418711.0| 50400100| -4.0| null|
    null|[subCategory -> [...|
    | 3418711.0| 50400100| -5.0| null|
    null|[subCategory -> [...|
    +----------+-----------+--------------+-------------------+----------------------+-------
    -------------+
    only showing top 5 rows

    (Final recs: ,())

    6 of 6 29/09/22, 8:11 pm

    You might also like