Definition: TPS

(1) (Transactions Per Second) The number of business transactions processed within one second. By measuring real work, TPS is a more practical rating of computer performance than the common raw CPU speed that is measured in gigahertz. TPS also stands for "transaction processing system," which is any online business system.

(2) (Tokens Per Second) The processing speed of an inference engine as it generates answers for the user. Tokens per second (TPS) is a performance metric, not a billing metric. Users are billed for the number of tokens generated no matter how long it takes.