CAN Transport and Network Layer
WARNING
The CAN bus part of the ThingSet protocol is still in an early stage and may change in the future.
This specification defines layer 3 (Network) and 4 (Transport) of the ThingSet Protocol via CAN bus. Layer 1 and 2 are provided by the CAN bus itself.
Only the binary messages of the ThingSet Protocol are supported via CAN.
General features
- Master-less operation
- Automatic node ID assignment
- Efficient useage of CAN ID and data bytes
- Transport protocol to allow payload of more than 8 bytes
- Two different types of messages for application layer
- Service message (request/response)
- Publication message (publish/subscribe)
- RTR frame is not allowed
- Fixed bitrate of 250 kbit
CAN identifier layout
In the CAN bus, the identifier part of the CAN frame is used for arbitration and identification of the message type. Typically, it does not define the sender or receiver of the message, but the content of the message.
For a network with connected ThingSet devices, the layout of the CAN identifier is similar to the SAE J1939 specification. Parts of the identifier define the source and destination address of the message. In addition to that, the first three bits are used to prioritize the messages.
Two general types of messages are specified: Service message and publication message. Only CAN extended IDs with a size of 29 bit are used.
Service message
A service message is used for the request/response messaging pattern. A single byte each for source and destination node address are defined as part of the CAN ID to identify sender and receiver of the message.
CAN identifier layout
The service message addressing in 29-bit CAN ID is similar to SAE J1939:
| Bits | 28 .. 26 | 25 | 24 | 23 .. 16 | 15 .. 8 | 7 .. 0 |
|---|---|---|---|---|---|---|
| Priority | 1 | 0 | reserved (0xDA) | Target address | Source address |
- Priority (28-26): Defines the importance of the message. For service messages, only 3 (high priority) or 7 (low priority) are valid.
- Extended data page / EDP (25): Always 1b to prevent collision with SAE J1939 and NMEA2000 devices on the same bus
- Message type (24): 0b for service message
- Reserved (23-16): Set to 218 (0xDA) as suggested by ISO-TP standard (ISO 15765-2) for normal fixed addressing with N_TAtype = physical
- Target address (15-8): Destination node address
- Source address (7-0): Source node address (255 for anonymous message during address claiming)
Transport protocol (ISO 15765-2)
In order to transfer data with a length of more than 8 bytes, the transfer protocol specified in ISO 15765-2 (ISO-TP)open in new window is used.
It allows a maximum number of 4095 data bytes (defined by 12 bit unsigned int length code in first frame). Flow control mechanisms ensure the reliability of data reception.
As a very important feature, ISO-TP allows the efficient transfer of single-frame messages with only one byte of overhead (and no flow control packets). This feature is necessary, as it is not known in advance if a certain function of the ThingSet protocol will transfer only a few bytes or a large amount of data.
The ISO-TP standard is not accessible for free. However, several open source implementations (including SocketCAN for Linuxopen in new window) of the ISO-TP are available. Most important information about the frame layout can be found on Wikipediaopen in new window.
Single-frame message request/response
Application protocol data of 7 bytes or lower can be transferred using a single CAN frame. The first byte of the CAN data contains the ISO-TP header for a single-frame message. Bytes 2 to n (with n <= 7) are contained in the remaining data bytes of the CAN frame.
| Byte 1 | Byte 2 | ... | Byte 8 |
|---|---|---|---|
| ISO-TP header | Application protocol (byte 1) | ... | Application protocol (byte 7) |
Multi-frame message request/response
More than 7 bytes of application protocol data are sent as multi-frame messages.
The first message contains two bytes for the ISO-TP header (including the total message length).
| Byte 1 | Byte 2 | Byte 3 | ... | Byte 8 |
|---|---|---|---|---|
| ISO-TP header | Application protocol (byte 1) | ... | Application protocol (byte 6) | |
Consecutive messages i = 2...585 consume only one byte for the ISO-TP header:
| Byte 1 | Byte 2 | ... | Byte 8 |
|---|---|---|---|
| ISO-TP header | Application protocol (byte (i-1)*7) | ... | Application protocol (byte i*7-1) |
Remarks regarding existing transport protocols
Several other transport protocols for CAN have been defined in different standards.
For the J1939 protocol, the transport protocol is specified in the standard SAE J1939-21. Two types of transport protocol are defined: The Connection Mode Data Transfer (CMDT) and the Broadcast Announce Message (BAM). CMDT is used to exchange data between two nodes. It includes methods for flow control and handshake. BAM is more simple and broadcasts a multi-packet message to the bus without feedback if the message was received.
CMDT and BAM allow to transfer 9 to 1785 bytes (255 packets * 7 bytes) of payload. It is not allowed to transfer 0 to 8 bytes using the J1939 transport protocols. Thus, we need to know before if a message needs the mechanisms of the transport protocol or not. This is not possible for the flexible ThingSet protocol, as the same functions might transfer either very little data (e.g. write 16-bit integer) or a large amount of data (e.g. write multiple values or strings). Data with less than 9 bytes would have to be stuffed, making the protocol very inefficient. A message which could fit into a single CAN frame would need 5 frames (including flow control) when using CMDT and stuffing.
The RV-C standard defines a different transport protocol than SAE J1939, which also allows the transfer of up to 1785 bytes. However, is does not specify any flow control mechanisms at all. So it is not possible to determine if a message was received even for a communication between only two nodes, which is not acceptable.
NMEA 2000 uses the same transport protocol as the SAE J1939 protocol. In addition to that, it defines a so-called fast packet protocol. With NMEA 2000 fast packet protocol, 223 bytes can be transferred without flow control, thus, making it more efficient and "fast".
With the fast packet protocol, a single frame transfer is possible. However, a single frame message consumes 2 out of 8 bytes for the fast packet header information. This is considered too high overhead if it is unknown whether a single or multi-frame message has to be used.
Overview of different CAN based transport protocols:
| ISO-TP | NMEA 2000 fast packet | SAE J1939-21 | RV-C | |
|---|---|---|---|---|
| Number of data bytes | 0..4095 | 0..223 | 9..1785 | 9..1785 |
| Flow control | yes | no | yes | no |
| Efficient single frame | yes | no | no | no |
| Open standard | no | no | no | yes |
Publication message
The publication message provides a very efficient way to send data in a regular interval using a single CAN frame without the overhead of a transport protocol. The publication messages are mainly intended for monitoring purposes.
CAN identifier layout
Publication messages are not sent to a single node, so the destination address does not need to be specified. Instead, the data node ID is specified directly in the CAN identifier to have more bytes available for payload in the data section of the CAN frame.
| Bits | 28 .. 26 | 25 | 24 | 23 .. 16 | 15 .. 8 | 7 .. 0 |
|---|---|---|---|---|---|---|
| Priority | 1 | 1 | Data node ID (MSB) | Data node ID (LSB) | Source address |
- Priority (28-26): Defines the importance of the message. For publication messages, only 4 (high priority), 5 (medium priority) and 6 (low priority) are valid.
- Extended data page / EDP (25): Always 1b to prevent collision with SAE J1939 and NMEA2000 devices on the same bus
- Message type (24): 1b for publication message
- Data node ID (23-8): Data node ID as a 16-bit unsigned integer. The most significant byte is stored first (bits 23 to 16).
- Source address (7-0): Source node address (255 for anonymous message during address claiming)
The data node ID is not encoded in the CBOR format, but as a raw 16-bit unsigned integer. The publication messages are limited to IDs that fit into 16 bits.
CAN data format
The data section of the CAN frame contains the CBOR-encoded value of the data node with the specified ID.
In order to acquire real-time measurement values, a 16-bit timestamp (unsigned int) can be appended to the CBOR-encoded value. The timestamp contains the 16 least significant bits of the microcontroller's system clock in milliseconds. It is a rolling counter and restarts at 0 after an overflow. The timestamp cannot be used to determine the absolute time of a measurement, but the time difference between subsequent measurements. This is important to obtain correct sampling of time-series data if higher priority messages cause a delay of the data delivery on the bus.
The maximum length of the value and the optional timestamp is defined by the maximum data section size of the CAN frame (8 bytes for classic CAN).
Physical layer
Bit rate
ThingSet uses a fixed bit rate of 500 kbit/s, which supports a maximum bus length of 100 m according to CiA 301.
Connector
Standard RJ45 jacks as used for Ethernet are also used as the default for ThingSet via CAN. The cables should be Cat 5e twisted pair or better, allowing reliable communication with easily available parts.
The pinout of the connector is similar to the CANopen specification:
| Pin # | Name | Description |
|---|---|---|
| 1 | CAN_H | CAN bus high signal |
| 2 | CAN_L | CAN bus low signal |
| 3 | GND | CAN and power supply GND (optional) |
| 4 | V+ | Bus power supply (optional, 12-24V nominal) |
| 5 | V+ | Bus power supply (optional, 12-24V nominal) |
| 6 | - | reserved (do not connect) |
| 7 | GND | CAN and power supply GND (optional) |
| 8 | (V+) | Unconnected by default, optional jumper to V+ |
The pinout specification aims to create as little interference with existing standards as possible. Most important, any damage must be prevented if a device is accidentally connected to a standard Ethernet jack.
In contrast to the CANopen specification, pin 8 is not used as the bus power supply (V+) by default. 10/100 MBit Ethernet jacks with integrated magnetics (e.g. these onesopen in new window) internally connect pin 4 to 5 and pin 7 to 8. In addition to that, Power over Ethernet (PoE) uses pins 4+5 for positive power rail and pins 7+8 for GND. So it's not ideal to use pin 7 as GND and pin 8 as V+. Boards can however offer a jumper to connect pin 8 with the other V+ pins (4 and 5) for bus supply of CANopen devices.
Galvanic isolation is not required, as long as all devices are connected via thick wires. This might change in the future.
One device typically has 2 RJ45 jacks for daisy-chaining the devices and maintaining the bus topology. There is no such thing like a switch needed. However, the endpoints have to be terminated with termination plugs or resistors.
A device that supplies power to V+ may not hard-connect the daisy-chained wires without any fuses in order to ensure that the current rating per wire is not exceeded. Devices without power supply may just route through the powered wires.
The maximum current per wire pair is 600 mA (300 mA per wire), same as PoE+ (IEEE 802.3at Type 2) with Cat 5e cables.
GitHub