Treasury publishes two rates for the same bill and they are not the same number, which is the single most useful thing to understand here. An auction result for a bill reports a high rate, which is a discount rate, and an investment rate, which Treasury's own auction result footnotes define as the "equivalent coupon-issue yield." Two separate conventions produce the difference, and both of them push in the same direction.
The discount rate is calculated against face value and on a 360-day year. TreasuryDirect gives the price formula outright: "Price = Face value (1 − (discount rate × time)/360)." So the rate is applied to the amount you will receive rather than to the amount you pay, and it is annualized over a year that is five days short.
The investment rate is calculated against the price actually paid and on a 365-day year. Because the price paid is smaller than the face value, dividing by it produces a larger figure; and because 365 is larger than 360, annualizing over it also produces a larger figure. The two adjustments compound rather than offsetting, which is why the investment rate on a bill bought at a discount is above its discount rate. On the rare bill that prices at par there is no discount and no interest, so nothing separates the two. Neither number is wrong. The discount rate is the auction convention and the investment rate is the figure that compares with a yield quoted on any other investment, which is what makes it the one to use when setting a bill beside a CD or a savings account.
Not insured, and the reason it does not need to be is different in kind. A bill carries no FDIC deposit insurance, because it is not a deposit at a bank. Deposit insurance exists to protect a depositor against the failure of the intermediary holding the money. A Treasury bill is a direct obligation of the United States, so there is no intermediary between the holder and the issuer to fail. Describing a bill as insured, or as guaranteed by the FDIC, gets the structure backwards. Where a bill is held in a brokerage account, the securities investor protection regime covers the custody of the security rather than its value, which is a different question again.
A bill has no inflation protection, and grouping it with instruments that do is a common error. Bills, certificates of deposit and savings accounts sit next to each other in every list of cash alternatives, so whatever is said about the group gets applied to all of them. Two distinctions are worth keeping. A bill's return is fixed in nominal terms at purchase, so if inflation runs above that return the real value of the money falls, exactly as with a CD. That is different from a Series I savings bond, whose rate includes a component that resets with measured inflation and which is therefore built to track it rather than be eroded by it. It is also different from a savings account, whose rate is variable and can rise during an inflationary period while a bill's cannot. What a bill does offer that a CD does not is a functioning secondary market, so the money can be reached before maturity by selling rather than by paying a penalty, at whatever price the market gives.
The state and local tax exemption is federal law rather than Treasury's choice. TreasuryDirect states the outcome for bills as "federal tax due on interest earned. No state or local taxes." The source is 31 USC 3124(a), which provides that obligations of the United States government are exempt from taxation by a state or a political subdivision of a state, with narrow carve-outs including a nondiscriminatory franchise tax on a corporation and estate or inheritance taxes. That is a uniform federal rule rather than fifty state policies, and it is the one structural advantage a bill has over a CD paying the same yield: for a holder in a state with an income tax, the same nominal yield is worth more after tax. Interest is reported on Form 1099-INT, and for an individual on the cash method it is recognized when the bill matures or is sold rather than accruing along the way; IRC 1281 requires current accrual only for specified holders such as accrual-method taxpayers, dealers and banks.