Precision loss is an error owing to the reduction of significant digits in the results of floating-point calculations. It occurs while subtracting values that are approximately equal or adding values that are almost equal in absolute value but have different signs.
Technical Terms
Precision loss
Technical Terms
Category
- Power Supplies
- Digital Control Programming
- 16bit
- 32bit
- API
- Argument
- Baud rate
- BCD
- Bit
- bps
- Byte
- CAN
- CC-Link
- Character
- Command Language
- Communication port
- Communication speed
- Container
- Debug
- Decimal
- Digit
- Driver
- Emulation
- Error Traps
- EtherNet/IP
- Floating-point
- GPIB
- Hexadecimal
- I2C
- Industrial Ethernet
- Industry 4.0
- IoT
- IVI
- LabVIEW
- Ladder/Ladder Language
- LAN
- Libraries
- Library (Programming Library)
- LXI
- M2M
- Master/Slave
- MATLAB
- Modbus
- Nominal (Nominal Value)
- NULL
- OSI Reference Model
- Overflow
- Packet
- Parity
- PLC
- PMbus
- Precision loss
- PROFIBUS
- PROFINET
- Programming Languages
- Protocol
- Python
- Queue
- Return value
- Rounding Error (Round-off Error)
- RS-232C
- RS-485
- SCPI
- SMbus
- Sockets
- SPI
- Stack
- String
- Subset
- Synchronization
- TCP
- Typical (Typical Value)
- UART
- UDP
- Underflow
- USB
- USBCDC
- USBTMC
- Variable
- Variable types
- VBA
- VISA
- Visual Basic
- Visual Basic .NET
- Visual C#
- Visual C++
- Word
- Wrapper
- X-ray
- Computed Tomography (CT)
- Laser