This repository contains multiple projects related to web scraping, REST API data extraction, and stock market data operations. It includes Jupyter Notebooks demonstrating how to collect, clean, analyze, and visualize data from various sources such as stock market APIs, census data, movie databases, and more.
The project leverages Python libraries like BeautifulSoup, Requests, Pandas, Matplotlib, Seaborn, SQLite, and Plotly to extract insights and build interactive visualizations.
π Stock Market Data Analysis
Analyzing_Historical_Stock_Revenue Data and Building a Dashboard.ipynbβ Extracts and visualizes historical stock data using APIs and Pandas.Extracting Stock Data Using a Python Library.ipynbβ Uses a Python library to retrieve stock data for analysis.Extracting Stock Data Using a Web Scraping.ipynbβ Demonstrates web scraping techniques for gathering stock market information.Golden_State.pklβ Pickle file storing processed stock data for further analysis.apple.csv,apple.json,amd.jsonβ Stock data files for Apple and AMD.
π Web Scraping & REST API
Web Scraping Top 2019 Movies at the Worldwide Box Office.ipynbβ Extracts movie revenue data using web scraping techniques.Content Web Scraping_Web-Scraping-Lab.ipynbβ Covers different methods of extracting data from websites.Extracting Data Via API.ipynbβ Demonstrates how to retrieve data using REST APIs.REST API.ipynbβ Hands-on implementation of working with RESTful APIs.
π Database & SQL Operations
CVD_Database_Create_Tables_Script.sqlβ SQL script for creating structured databases.SQLITE DATABASES with PYTHON.ipynbβ Shows how to interact with SQLite databases using Python.FinalDB.dbβ SQLite database storing structured data.
π Census & Public Data Analysis
Census_Data_-_Selected_socioeconomic_indicators_in_Chicago__2008___2012_20240227.csvβ Census dataset containing socioeconomic indicators.ChicagoCensusData.csv,ChicagoCrimeData.csv,ChicagoPublicSchools.csv,Chicago_Public_Schools_-_Progress_Report_Cards__2011-2012__20240227.csvβ Chicagoβs census, crime, and education datasets for exploratory analysis.games.csvβ Data related to games industry analysis.
π Miscellaneous
file_list.txtβ List of files in the repository.
β
Web Scraping: Extracts structured and unstructured data from web sources.
β
REST API Integration: Retrieves real-time stock and public data via APIs.
β
Stock Market Analysis: Uses Python libraries to analyze and visualize stock trends.
β
Database Management: Demonstrates SQL and Python-based database interactions.
β
Data Cleaning & Preprocessing: Applies EDA techniques to real-world datasets.
β
Interactive Dashboards: Uses Plotly and Matplotlib to create visual reports.
πΉ Python β Pandas, Matplotlib, Seaborn, Plotly, BeautifulSoup, Requests
πΉ Web Scraping β BeautifulSoup, Requests, Selenium
πΉ REST APIs β API calls with Python
πΉ Stock Market Analysis β Yahoo Finance, Alpha Vantage APIs
πΉ SQL β SQLite database operations
πΉ Data Visualization β Matplotlib, Seaborn, Dash
π Expand stock analysis with real-time data feeds
π Automate data extraction for daily stock updates
π Build a Flask API to serve stock insights
π Enhance web scraping with Selenium for dynamic content
Feel free to contribute by submitting issues, feature requests, or pull requests!