Project Documentation

Phase 1 (Table: filings1)

CREATE TABLE filings1 (
    order_num INT PRIMARY KEY,
    company VARCHAR(500) NOT NULL,
    reported_funding VARCHAR(100),
    incremental_cash VARCHAR(100),
    filing_date DATE NOT NULL,
    new_or_amended VARCHAR(20)
);

- Works with Python 3+
- Latest records always have the highest order_num
- Running mainv1.py deletes all existing data and re-scrapes everything for the current date
- Currently works only on Linux (due to time.tzset()); modifications are needed for macOS or Windows

------------------------------------------------------------

Phase 2 (Table: filings2)

CREATE TABLE filings2 (
    order_num INT PRIMARY KEY,
    company VARCHAR(500) NOT NULL,
    reported_funding VARCHAR(100),
    incremental_cash VARCHAR(100),
    filing_date DATE NOT NULL,
    new_or_amended VARCHAR(20),
    company_address VARCHAR(500),
    company_all_contact VARCHAR(1500)
);

- Works with Python 3+
- Latest records always have the highest order_num
- Running mainv2.py does NOT delete existing data; instead, it updates only new entries to reduce scraping time
- Currently works only on Linux (due to time.tzset()); modifications are needed for macOS or Windows