Precision loss is an error owing to the reduction of significant digits in the results of floating-point calculations. It occurs while subtracting values that are approximately equal or adding values that are almost equal in absolute value but have different signs.
Technical Terms
Precision loss
Technical Terms
Category
- Power Supplies
- Digital Control Programming
- Wrapper
- Word
- Visual C++
- Visual C#
- Visual Basic .NET
- Visual Basic
- VISA
- VBA
- Variable types
- Variable
- USBTMC
- USBCDC
- USB
- Underflow
- UDP
- UART
- Typical (Typical Value)
- TCP
- Synchronization
- Subset
- String
- Stack
- SPI
- Sockets
- SMbus
- SCPI
- RS-485
- RS-232C
- Rounding Error (Round-off Error)
- Return value
- Queue
- Python
- Protocol
- Programming Languages
- PROFINET
- PROFIBUS
- Precision loss
- PMbus
- PLC
- Parity
- Packet
- Overflow
- OSI Reference Model
- NULL
- Nominal (Nominal Value)
- Modbus
- MATLAB
- Master/Slave
- M2M
- LXI
- Library (Programming Library)
- Libraries
- LAN
- Ladder/Ladder Language
- LabVIEW
- IVI
- IoT
- Industry 4.0
- Industrial Ethernet
- I2C
- Hexadecimal
- GPIB
- Floating-point
- EtherNet/IP
- Error Traps
- Emulation
- Driver
- Digit
- Decimal
- Debug
- Container
- Communication speed
- Communication port
- Command Language
- Character
- CC-Link
- CAN
- Byte
- bps
- Bit
- BCD
- Baud rate
- Argument
- API
- 32bit
- 16bit
- X-ray
- Computed Tomography (CT)
- Laser