Projects

Automated ETL Utilizes Python, Boto3, and web scraping for data acquisition, ensuring end-to-end automation. Configures AWS EC2, S3, and Redshift clusters, applying best practices for security and scalability. Enhances data processing with Pandas, SQL, and web scraping, ensuring efficient data transformation.

Iterates through a list of pages, sends HTTP requests to IMDb's top movie listings, and extracts information such as movie name, year of release, runtime, rating, Metascore, votes, and description. The script uses BeautifulSoup for web scraping, random delays to avoid overwhelming the server, and headers to mimic a web browser.

• Introduction:

Welcome to EduRate, a cutting-edge feedback system designed to elevate the standards of education by fostering continuous improvement initiatives and supporting the growth and development of faculty members. Deployed on AWS with Python, MySQL, PHPMyAdmin, and Nginx, EduRate is a web-based platform that streamlines the feedback collection process, providing valuable insights to enhance the educational experience.

• Definition:

EduRate is a comprehensive feedback system that seeks to improve the quality of education by aggregating feedback from students on a semester, subject, and faculty member basis. Through the collection of diverse parameters such as functionality, teaching strategy, paper solutions, and practical aspects, EduRate compiles data into a structured database, generating detailed reports to aid faculty members in their professional development.

• Features:

1. Custom Admin Panel:

   Create and manage specific IDs for students to access the feedback form.

   Ability to delete, show, and modify created IDs.

   Dynamic update of faculty details, including name, subject, and subject code.

2. Feedback Operation Control:

   Admin can selectively enable feedback for specific semesters and IDs.

   Secure authentication to prevent unauthorized access.

   Password recovery options for admin.

3. Dynamic Faculty Details:

   Admin has the flexibility to update faculty information, ensuring real-time accuracy.

   Customizable parameters for feedback, covering functionality, teaching strategy, attitude, and practical aspects.

4. Reporting Capabilities:

   Generate detailed, text-based reports for faculty members, subject-wise.

   Reports encompass multiple parameters, providing a holistic view of performance throughout the semester.

5. Data Management:

   Admin has full control to block feedback forms, allowing for precise data collection.

   Ability to view, delete, and export data, facilitating efficient data management.

   Downloadable PDF report files for comprehensive analysis.

Unemployment is a critical economic indicator, and analyzing unemployment data can provide insights into the labor market's health. The COVID-19 pandemic has had a profound impact on unemployment rates worldwide, making it a relevant and interesting subject for data analysis. In this project, we'll use Python to conduct an EDA on unemployment data, aiming to gain a better understanding of unemployment trends, patterns, and their relationship with other factors.

I have to provide a yaml cloudformation script for automate and manage IAC in easy way.
AWS-cloudformation templates including all the IAC configuration including EC2, VPC, AWS Backup, Cloudwatch, SNS, RDS etc...

This is your Project description. A brief summary can help visitors understand the context of your work. Click on "Edit Text" or double click on the text box to start.