The four things that change, and none of them is optional.
Nobody withholds. Employment withholds tax at source and reconciles it on a return. A side hustle pays you gross. The obligation to fund the year's tax as the income is earned does not disappear; it moves to you. There are two ways to meet it, and having a job is what makes the second one available: making quarterly estimated payments, or increasing withholding on the W-2 job so the paycheck covers both incomes. Withholding counts toward the same annual obligation that estimated payments do, and it is administratively simpler than four dated payments, which is why a household with one employed spouse and one self-employed spouse often uses it rather than estimated taxes.
A second tax appears. Employment splits Social Security and Medicare tax between the worker and the employer. Self-employment does not, so the whole of it falls on you, computed on the business profit. It is a separate charge from income tax and it is the item that most often accounts for the gap between what a first-year side business earned and what its owner was allowed to keep. Its own page has the computation, which is not simply a percentage of the profit.
The profit is what is taxed, so the records are the deduction. Ordinary and necessary costs of carrying on the business reduce the amount subject to both taxes. That makes recordkeeping the mechanism by which the deduction exists rather than an administrative afterthought, and it is why a side business that keeps no records typically overpays. Mileage, supplies, fees, a share of a phone bill and, where it strictly qualifies, part of the home all belong in that calculation, and each has its own substantiation requirement.
Whether it is a business at all becomes a live question. The gate is whether the activity is a trade or business, which turns on continuity and a real profit motive rather than on hours or size. It matters most when the activity loses money, because a hobby's expenses cannot be deducted against other income while a business's losses generally can. Nobody elects the answer; it is drawn from how the activity is conducted.
Interactions with the main job that are easy to miss. The Social Security portion of the tax applies only up to an annual ceiling, and W-2 wages count toward that ceiling first, so a high earner with a side business may find only the Medicare portion reaches the side income. Contributing to a workplace retirement plan does not close off a plan for the business, though the employee deferral limit is shared across plans while the employer contribution is not. And a payer sending you a form is not what makes the income taxable: the income is reportable whether or not any form arrives, and the reporting thresholds that decide whether one does are conditional rather than a simple dollar floor.
What the phrase obscures. "Side hustle" makes the activity sound provisional, which affects how people treat it: as a hobby for record-keeping purposes and as a business for the tax bill. The obligations arrive on the first dollar of profit, not at the point it starts to feel serious, and the cheapest time to set up a separate account and a simple ledger is before there is anything much in it.