2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,

Coimbatore, India

Automated E-Commerce Price Comparison Website using

PHP, XAMPP, MongoDB, Django, and Web Scrapping
2023 International Conference on Computer Communication and Informatics (ICCCI) | 979-8-3503-4821-7/23/$31.00 ©2023 IEEE | DOI: 10.1109/ICCCI56745.2023.10128573

Nagaraj P Muneeswaran V A V S R Pavan Naidu

Department of Computer Science and
Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
nagaraj.p@klu.ac.in
Department of Electronics and
Communication Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
munees.klu@gmail.com
Department of Computer Science and
Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
9920004672@klu.ac.in

N Shanmukh P Vinod Kumar G Sri Satyanarayana

Department of Computer Science and
Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
9920004626@klu.ac.in
Department of Computer Science and
Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
9920004709@klu.ac.in
Department of Computer Science and
Engineering
Kalasalingam Academy of Research and
Education
Krishnankoil, Virudhunagar, India
992004648@klu.ac.in

Abstract— normal technique for price comparison of 21% of e-

Background:
Every online user wants a detailed review about the product they
buy or the product they are interested in. Buyers research
various websites on the internet to get the best offers on their
desired products.
Purpose:
We need a model which can give us the details of the products
from different websites.
Method:
In this paper, we are trying to utilize PHP, XAMPP, and
MongoDB to build a website to get the prices of any desired
product from Amazon and Flipkart.
Result:
Experimental evaluations showed that this proposed website
shows the prices of the desired product from Amazon and
Flipkart with an accuracy of 96%.
Keywords—Price Comparison, Products, Amazon, Flipkart,
Web Scraping, Data Extraction, XAMPP, PHP, MariaDB,
MongoDB, Django Web Framework.
I. INTRODUCTION
Nowadays, every online user looks for the best deals before
buying their desired product. One of the main factors that
lead to the purchase of a product is the price or cost of the
product. Buyers tend to compare prices before buying a
product. But since it is not that easy to search for the product
on every price website, indeed there must be a solution to
automate this whole process [1].
A web scraper is an automated program that retrieves
information from various websites. This increases web
traffic by up to 55% because of security issues. Price
scraping or price comparison is a method that compares the
prices of a product from different websites [2]. If we use the
commerce traffic then we came to implement some
techniques. This website dynamically there no cost
adjustment issues this model achieves an overall accuracy of
78% for price comparison we have used 100 categories from
Amazon and Flipkart we have obtained a precision of 96%.
This website helps to compare the prices from different
E-commerce websites. This website is very useful for online
shoppers who shop frequently, to check the prices of various
online stores in one place [3]. This system gives you the
prices of products from various sellers to show you where to
buy the product for an affordable price. Any two classes of
the web are analyzed to get the price details. To get the
required price details of the desired product the system visits
the website based on the search and downloads of the user.
Once the prices from the websites are loaded, they will be
displayed on the website in the form of a price comparison.
E-commerce applications have different parts, for
example, a database server, a web application server, and the
PGI for transactions online. The internet has changed the
way many people and organizations think and work [4].
For this review, a shrewd item search framework was
fostered that empowers PCSs to help amateur customers
explicitly by obliging client-characterized cost ranges. In
this, a "beginner customer" is characterized as a web-based
customer who is keen on a specific item classification and
wishes to make a buy inside an estimated financial plan, but
who is experiencing issues choosing a particular item
attributable to an absence of earlier information on the
objective item class.
Automated e-commerce creates new economic values
by making business processes easier and also by opening
possibilities for market interactions. These technologies
provide e-commerce sellers with unprecedented
opportunities to price discriminate. We show that this can be
good for consumers and that the focus of regulations should
not be on disallowing such practices [5].

979-8-3503-4821-7/23/$31.00 ©2023 IEEE

Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
 2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,
Coimbatore, India

II. RELATED WORKS

Ref. No. Author Details Type of the website Features of the website Results

[6] Nimbalkar et al Spam bot Post-Comment similarity, 86% accuracy has been
the ratio of stop words, achieved by this model
and redundancy using the Decision tree
classifier

[7] Khatter et al Real-time bot HTTP response code and Bots were discovered
Inter arrival time before the session
expired

[8] Dharmik et al Web Crawler Percentage of requested 95% accuracy has been
images, duration of the achieved by this model
session, and the response
code from the web.

[9] Sharma et al. Chatbot Size of the Message and 100% accuracy has been
the delay time between achieved by this model
them

[10] Sarker et al. Web Scarper The entropy of inter- 91% accuracy has been
request time and achieved by this model
requested bytes

[11] Raza et al. Social Media bot Probability of transition The accuracy of the
features between the user model has increased by
and click streams an average of 91% in
total

[12] Chee et al. Price Scraping bot Twenty-five features as
total requested pages,
session time, the standard
deviation of time between
the requests
90% accuracy has been
achieved using Cascade
neural network

Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
 2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,
Coimbatore, India
III. MATERIALS AND METHODS
1. MongoDB
It is a document-oriented database that is classified
under NoSQL. The system can deal with large amounts of
unstructured data hence it is easier to use MongoDB as the
database. The extracted data using the scraper is stored in
the MongoDB database [13].
2. Django Web Framework
Django is a python web framework. E-commerce product
comparison using web scraping is a product price
comparison website that is made using the Django web
framework. Products that are requested by users are queried
in the database using a mapper mongo-engine which is
object related [14-18].
PHASE 1:
Data Collection and Analysis - A series of investigations
yielded useful information on power and energy
consumption. Also, the results that turned into results gained
better know-how about what a rating website is, all about the
way it helps people to solve problems before buying home
groceries and examples for current rating websites to test
against competitors. Previous research statistics are obtained
from student-written term papers and have been defined in
the literature review phase information earlier. Meanwhile,
customer statistics were obtained through a survey and
interview conducted by online respondents in addition to
assembly [19-22].
PHASE 2:
Survey of any existing similar system - The next step is to
look at the results achieved and test if there is any machine
that's similar or comparable. The main theme of conducting
the study on a comparable current machine is to know how it
works, what idea is being worked within the machine, what
is calculated with the help of the machine, and how the
difficulties are handled by the machine [23-27].
PHASE 3:
Design of the main components of the system - After
studies on current comparable systems, the next thing to do
is to realize what will be the main thing that will make the
machine get advanced. For the operation of this website to
use its services, they must log in with their basic records, i.e.,
Name, E-mail, etc. Customers who are registered can be
mechanically given access to the newsletter of this website.
Customers will be able to select a product and related listings
can be displayed. In addition, customers can also upload
additional information such as their preferred goods to their
profile, so that the current charge of favorite gadgets can be
sent to the customer individually in addition to the day's
merchandise mail. Thus, the consumer may be able to obtain
the records in which he participates without delay. The main
additions of the machine are A flexible database for storing
goods and customer records. A user will be able to search for
the product he is involved in [28-33].
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
PHASE 4:
Develop the model architecture - The following section is
to explain the structure and working of the machine. This
provides a clear picture of the system, and how the machine
works and prevents it from becoming a machine that does not
solve the problems.
WEB CRAWLER :
Web Crawlers or Web Spiders are used to automatically
search websites and gather information over the internet. The
first aspect is, the re-fetched URLs will be sent to the scraper
for scraping.
WEB SCRAPER :
It is used to extract the HTML statistics from URLs sent
by the crawler and use them for purposes that are not public.
In this gadget, python libraries like requests and
beautifulsoup4 are used to achieve scraping. Beautifulsoup4
is a python library used for HTML page parsing. Using this
data, product information from various unique e-commerce
websites is extracted and stored in a database.
IV. Proposed Methodology
Fig.1 Proposed Architecture
In this paper, we are going to develop a website where
the prices of the desired products from Amazon and Flipkart
are displayed using PHP, XAMPP, MongoDB, and web
scraping. Fig.1 describes the architecture of the proposed
system.
We’ve used ‘XAMPP’ for the implementation of our
code. This package includes MySQL, Apache web server,
Perl, FTP server, PHP, and also phpMyAdmin.
PHP is a scripting language used for servers and a very
useful tool used for making interactive and interactive web
pages. No dataset is present in the project, the data is
scrapped on its own by web scraping and the results are
displayed. This software collection also includes many other
components, which are explained below.
XAMPP Control Panel:
It helps to control and regulate various components
present in XAMPP. The latest update of this software is
Version 3.2.1.
 2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,
Coimbatore, India

Cross-platform: is that it is a server-side Scripting Language; i.e, you can just

Various locales have Various configurations of installed
operating systems. A cross-platform component has been
included to raise the usage and users for this Apache
distribution package. It extends support for various
platforms such as Windows, MAC, and Linux OS packages.
Apache:
This is an HTTP cross-platform web server. It is used to
deliver web content worldwide. The server application is
cost-free to install and is used by the developer community
under the auspices of the Apache Software Foundation. The
user gets the delivery of requested files, images, and other
documents with the help of a remote Apache server.
PHP:
It is a scripting language that is used in the backend
primarily used for web application development. It is easily
installable on any platform and also supports various
database management systems. C language is used for the
implementation. Hypertext Processor is implied by PHP and
is said to be derived from the tools of Personal Home Page,
this explains its functionality and simplicity.
MariaDB:
MySQL DBMS has been a part of XAMPP. But now it
has been replaced by MariaDB. It is developed by MySQL
and is one of the most extensively used relational DBMSs.
It offers various online services for storing, manipulating,
searching, organizing, and deleting data.
install it from the open server and the client computers. It is
not necessary to have PHP installed when requesting
resources from the server, only the browser would be
enough.
What are the requirements to Build a PHP Website?
Before starting, make sure that there is plain text or a PHP
editor installed in the development environment. To upload
the files, we need a PHP web server. It can be a local
computer with LAMP or a remote server.
Creating a website using PHP:
Our basic PHP website will include a home page,
including pricing the product from the search results and
some images on the e-commerce website. For this PHP
website, you need to create a PHP page filled with content
based on three HTML pages. The file that you’ve created
can be edited by editing text and images from the base
HTML files.

Implementing the project using PHP:

PHP is a very widely-used server-side scripting language
for web development. There is various web server software
for setting up our local web server. Amongst them, XAMPP
and Wamp Server are the most popular. XAMPP is a cross-
platform application that can run on Windows, Linux, and
macOS. Hence, we are using PHP in XAMPP for this
project.

Fig 3. Web Scraping using PHP

Fig 2. XAMPP Control Panel Fig 4. Web Scraping using PHP

Why PHP?
Like MySQL, PHP is free to use and also open source.
Packages such as XAMPP already have a web server,
MySQL, and PHP among others. This makes PHP a cost-
effective scripting language when compared to languages
such as CFML or ASP. One of the other advantages of PHP
Using Simple HTML Dom
It is a library developed for PHP versions and it helps us
to access the page’s content in a much easier way with
selectors. You only need the simple HTML dom.php file
from the zip file. This file should be placed in the same

Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
 2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,
Coimbatore, India

folder where you wrote your scraper code. Install PHP-

CURL is Not always required, but for more advanced
requests you may need to send different headers.

Installing PHP-CURL
It's not always necessary, but for more advanced requests
you should send different headers. Using the PHP-CURL
library will help. Don't forget to restart the Apache server
after installing the library. Fig.2, 3, and 4 indicate the XAMP
model for the control panel and Web Scraping using PHP.
Scraping the content from various websites :

1. Check the website content Fig 5. The interface of the Price Comparison Website
Most web content is displayed using HTML. Since we
need to extract specific content from the HTML source, it is
also necessary to understand it. First, we need to check what
the source of the page looks like to know what elements to
extract from the page.
In Google Chrome, you can do this by right-clicking on
the element you want to extract and selecting "Inspect
Element". This should open a window in your browser with
the page source and rendered element styles. In this window,
we only need to check the "Elements" tab, which will show
us how the HTML home of the page is structured.

2. Send the request from PHP

Sending a request in this case means accessing the
HTML page directly using PHP code. This can be achieved
in two ways. First, we can use the PHP-CURL library, which
also allows us to modify the headers and body that we send
in our request.
3. Extract the data
We will only extract the title of the films and the rating
associated with each of them from the page we have chosen.
As we saw earlier, the content is displayed in a table where
each cell has its class. Using this we can choose to extract
all rows of the table. We then look at the cells of interest in
each row.
After retrieving the rows, we looped through them
looking for elements with the class name Column or rating
column. It is important to note that in this example we used
file_get_html instead of file_get_contents. This is because
this function comes from the simple_html_dom library and
acts as a wrapper for the file_get_contents function.
4. Export the data
In the examples above, we collected the site data and
displayed it directly on the screen. However, you can also
save data in PHP quite easily. You can save the scraped data
to a .txt file, as JSON, as CSV, or even send it directly to a
database. PHP is doing very well.
We need to save it in an array and put the contents of the
array in a new file. quired is to collect a huge amount of
statistics from unique e-commerce websites. Manually
retrieving statistics from websites is not possible. So, a good
way is to create an internet crawler to go to these e-trade
websites. Fig. 5 and 6 depict the interface models.
Fig 6. Prices of the Desired Product from Amazon and
Flipkart
VI. CONCLUSION AND FUTURE WORK
We have completed a web scraping e-commerce price
comparison website with Web Scraping. A website that
provides price comparison with different online shopping
websites like Flipkart, and Amazon for providing the best
deal for the same product with the help of web scraping
(PHP simple DOM), and it is based on PHP.
Prices from different e-commerce websites can be
compared using this product price comparison website. It is
very useful for online shoppers who shop frequently to
check the prices of various online stores in a place. This
system shows you the prices of products from various sellers
to show you the best site to buy the product for a reasonable
price. The best two classes of web pages are analyzed for
getting the price information. To get the price details the
system babbles the website based on the user searches and
then it downloads the HTML search page of that particular
web page. After both websites’ product prices are loaded,
they will be exhibited on the interface of the website in the
form of price comparison.
REFERENCES
1. Shalini, A., & Ambikapathy, M. R. (2022). E-Commerce Analysis and
Product Price Comparison Using Web Mining. Journal homepage: www.
ijrpr. com ISSN, 2582, 7421.
2. Avron, U., Gershtein, S., Guy, I., Milo, T., & Novgorodov, S. (2022).
Automated Category Tree Construction in E-Commerce.

Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
 2023 International Conference on Computer Communication and Informatics (ICCCI), Jan 23-25, 2023,
Coimbatore, India
3. Al-Mushayt, O. S., Gharibi, W., & Armi, N. (2022). An E-
Commerce Control Unit for Addressing Online Transactions in
Developing Countries: Saudi Arabia—Case Study. IEEE
Access, 10, 64283-64291.
4. Zhang, X., Shen, K., Zhang, C., Fan, X., Xiao, Y., He, Z., ... &
Wu, L. (2022). Scenario-based Multi-product Advertising
Copywriting Generation for E-Commerce. arXiv preprint
arXiv:2205.10530.
5. Niemir, M., & Mrugalska, B. (2022). Product Data Quality in e-
Commerce: Key Success Factors and Challenges. Production
Management and Process Control, 36, 1-12.
6. Nimbalkar, T. R., Bhadane, L. G., Kharatmal, D. B., & Borase,
J. P. E-COMMERCE PORTAL WITH RECOMMENDATION
SYSTEM FOR SURGICAL EQUIPMENT. Journal
homepage: www. ijrpr. com ISSN, 2582, 7421.
7. Khatter, H., Sharma, A., & Kushwaha, A. K. (2022, July). Web
Scraping based Product Comparison Model for E-Commerce
Websites. In 2022 IEEE International Conference on Data
Science and Information System (ICDSIS) (pp. 1-6). IEEE.
8. Dharmik, H., Padmane, P., Dhoke, K., Chambhare, S., &
Kohad, D. A Review on E-commerce Price Evaluation System.
9. Sharma, D. K., Lohana, S., Arora, S., Dixit, A., Tiwari, M., &
Tiwari, T. (2022). E-Commerce product comparison portal for
classification of customer data based on data mining. Materials
Today: Proceedings, 51, 166-171.
10. Sarker, K. U., Saqib, M., Hasan, R., Mahmood, S., Hussain, S.,
Abbas, A., & Deraman, A. (2022). A Ranking Learning Model
by K-Means Clustering Technique for Web Scraped Movie
Data. Computers, 11(11), 158.
11. Raza, M. Z., Verma, P., Abirami, G., & Girija, R. (2022).
Prediction of Consumer Purchase Intention Using E-Commerce
Web Data. Telematique, 6679-6690.
12. Chee, C. C. F. C., Chiew, K. L., Sarbini, I. N., & Jing, E. K. H.
(2022). Data Analytics Approach for Short-term Sales Forecasts
Using Limited Information in E-commerce Marketplace. Acta
Informatica Pragensia, 11(3).
13. Nagaraj, P., & Deepalakshmi, P. (2020). A framework for e-
healthcare management service using recommender
system. Electronic Government, an International
Journal, 16(1-2), 84-100.
14. Nagaraj, P., Deepalakshmi, P., Mansour, R. F., & Almazroa, A.
(2021). Artificial flora algorithm-based feature selection with
gradient boosted tree model for diabetes
classification. Diabetes, Metabolic Syndrome and Obesity:
Targets and Therapy, 14, 2789.
15. Pa, N., Mb, A., Kb, B., & Ab, D. (2020). Analysis of data
mining techniques in diagnalising heart disease. Intelligent
Systems and Computer Technology, 37, 257.
16. Vb, S. K. (2020). Perceptual image super resolution using deep
learning and super resolution convolution neural networks
(SRCNN). Intelligent Systems and Computer
Technology, 37(3).
17. Nagaraj, P., & Deepalakshmi, P. (2021). Diabetes Prediction
Using Enhanced SVM and Deep Neural Network Learning
Techniques: An Algorithmic Approach for Early Screening of
Diabetes. International Journal of Healthcare Information
Systems and Informatics (IJHISI), 16(4), 1-20.
18. Nagaraj, P., & Deepalakshmi, P. (2022). An intelligent fuzzy
inference rule‐based expert recommendation system for
predictive diabetes diagnosis. International Journal of Imaging
Systems and Technology.
19. Nagaraj, P., Deepalakshmi, P., & Ijaz, M. F. (2022). Optimized
adaptive tree seed Kalman filter for a diabetes recommendation
system—bilevel performance improvement strategy for
healthcare applications. In Cognitive and Soft Computing
Techniques for the Analysis of Healthcare Data (pp. 191-202).
Academic Press.
20. Vignesh, K., & Nagaraj, P. (2022). Analysing the Nutritional
Facts in Mc. Donald’s Menu Items Using Exploratory Data
Analysis in R. In International Conference on Emerging
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY SURATHKAL. Downloaded on October 15,2023 at 12:55:30 UTC from IEEE Xplore. Restrictions apply.
Technologies in Computer Engineering (pp. 573-583).
Springer, Cham.
21. Brintha, N. C., Nagaraj, P., Tejasri, A., Durga, B. V., Teja, M.
T., & Kumar, M. N. V. P. (2022, June). A Food
Recommendation System for Predictive Diabetic Patients using
ANN and CNN. In 2022 7th International Conference on
Communication and Electronics Systems (ICCES) (pp. 1364-
1371). IEEE.
22. Nagaraj, P., Deepalakshmi, P., Muneeswaran, V., & Muthamil
Sudar, K. (2022). Sentiment Analysis on Diabetes Diagnosis
Health Care Using Machine Learning Technique. In Congress
on Intelligent Systems (pp. 491-502). Springer, Singapore.
23. Nagaraj, P., Muneeswaran, V., Reddy, L. V., Upendra, P., &
Reddy, M. V. V. (2020, May). Programmed multi-classification
of brain tumor images using deep neural network. In 2020 4th
international conference on intelligent computing and control
systems (ICICCS) (pp. 865-870). IEEE.
24. Nagaraj, P., Rajasekaran, M. P., Muneeswaran, V., Sudar, K.
M., & Gokul, K. (2020, August). VLSI implementation of
image compression using TSA optimized discrete wavelet
transform techniques. In 2020 Third International Conference
on Smart Systems and Inventive Technology (ICSSIT) (pp. 667-
670). IEEE.
25. Vamsi, A. M., Deepalakshmi, P., Nagaraj, P., Awasthi, A., &
Raj, A. (2020). IOT based autonomous inventory management
for warehouses. In EAI International Conference on Big Data
Innovation for Sustainable Cognitive Computing (pp. 371-376).
Springer, Cham.
26. Muneeswaran, V., Nagaraj, P., Dhannushree, U., Ishwarya
Lakshmi, S., Aishwarya, R., & Sunethra, B. (2021). A
Framework for Data Analytics-Based Healthcare Systems.
In Innovative Data Communication Technologies and
Application (pp. 83-96). Springer, Singapore.
27. Nagaraj, P., Rao, J. S., Muneeswaran, V., & Kumar, A. S. (2020,
May). Competent ultra data compression by enhanced features
excerption using deep learning techniques. In 2020 4th
International Conference on Intelligent Computing and Control
Systems (ICICCS) (pp. 1061-1066). IEEE.
28. Muneeswaran, V., Nagaraj, M. P., Rajasekaran, M. P.,
Chaithanya, N. S., Babajan, S., & Reddy, S. U. (2021, July).
Indigenous Health Tracking Analyzer Using IoT. In 2021 6th
International Conference on Communication and Electronics
Systems (ICCES) (pp. 530-533). IEEE.
29. Muneeswaran, V., BenSujitha, B., Sujin, B., & Nagaraj, P.
(2020). A compendious study on security challenges in big data
and approaches of feature selection. International Journal of
Control and Automation, 13(3), 23-31.
30. Varma, C. G., Nagaraj, P., Muneeswaran, V., Mokshagni, M.,
& Jaswanth, M. (2021, May). Astute Segmentation and
Classification of leucocytes in blood microscopic smear images
using titivated K-means clustering and robust SVM techniques.
In 2021 5th International Conference on Intelligent Computing
and Control Systems (ICICCS) (pp. 818-824). IEEE.
31. Sudar, K. M., Nagaraj, P., Deepalakshmi, P., & Chinnasamy, P.
(2021, January). Analysis of Intruder Detection in Big Data
Analytics. In 2021 International Conference on Computer
Communication and Informatics (ICCCI) (pp. 1-5). IEEE.
32. Sudar, K. M., Deepalakshmi, P., Nagaraj, P., & Muneeswaran,
V. (2020, November). Analysis of Cyberattacks and its
Detection Mechanisms. In 2020 Fifth International Conference
on Research in Computational Intelligence and Communication
Networks (ICRCICN) (pp. 12-16). IEEE.
33. Sudar, K. M., Deepalakshmi, P., Ponmozhi, K., & Nagaraj, P.
(2019, December). Analysis of Security Threats and
Countermeasures for various Biometric Techniques. In 2019
IEEE International Conference on Clean Energy and Energy
Efficient Electronics Circuit for Sustainable Development
(INCCES) (pp. 1-6). IEEE.