suricata
tmqh-packetpool.c File Reference
#include "suricata.h"
#include "packet-queue.h"
#include "decode.h"
#include "detect.h"
#include "detect-uricontent.h"
#include "threads.h"
#include "threadvars.h"
#include "flow.h"
#include "flow-util.h"
#include "host.h"
#include "stream.h"
#include "stream-tcp-reassemble.h"
#include "tm-queuehandlers.h"
#include "tm-threads.h"
#include "tm-modules.h"
#include "pkt-var.h"
#include "tmqh-packetpool.h"
#include "util-debug.h"
#include "util-error.h"
#include "util-profiling.h"
#include "util-device.h"
Include dependency graph for tmqh-packetpool.c:

Go to the source code of this file.

Macros

#define MAX_PENDING_RETURN_PACKETS   32
 
#define RESERVED_PACKETS   10
 

Functions

void TmqhPacketpoolRegister (void)
 TmqhPacketpoolRegister \initonly. More...
 
void PacketPoolWait (void)
 
void PacketPoolWaitForN (int n)
 Wait until we have the requested amount of packets in the pool. More...
 
PacketPacketPoolGetPacket (void)
 Get a new packet from the packet pool. More...
 
void PacketPoolReturnPacket (Packet *p)
 Return packet to Packet pool. More...
 
void PacketPoolInitEmpty (void)
 
void PacketPoolInit (void)
 
void PacketPoolDestroy (void)
 
PacketTmqhInputPacketpool (ThreadVars *tv)
 
void TmqhOutputPacketpool (ThreadVars *t, Packet *p)
 
void TmqhReleasePacketsToPacketPool (PacketQueue *pq)
 Release all the packets in the queue back to the packetpool. Mainly used by threads that have failed, and wants to return the packets back to the packetpool. More...
 
void PacketPoolPostRunmodes (void)
 Set the max_pending_return_packets value. More...
 

Variables

thread_local PktPool thread_pkt_pool
 

Detailed Description

Author
Victor Julien victo.nosp@m.r@in.nosp@m.linia.nosp@m.c.ne.nosp@m.t

Packetpool queue handlers. Packet pool is implemented as a stack.

Definition in file tmqh-packetpool.c.

Macro Definition Documentation

◆ MAX_PENDING_RETURN_PACKETS

#define MAX_PENDING_RETURN_PACKETS   32

Definition at line 55 of file tmqh-packetpool.c.

◆ RESERVED_PACKETS

#define RESERVED_PACKETS   10

number of packets to keep reserved when calculating the the pending return packets count. This assumes we need at max 10 packets in one PacketPoolWaitForN call. The actual number is 9 now, so this has a bit of margin.

Definition at line 498 of file tmqh-packetpool.c.

Function Documentation

◆ PacketPoolDestroy()

void PacketPoolDestroy ( void  )

Definition at line 335 of file tmqh-packetpool.c.

◆ PacketPoolGetPacket()

Packet* PacketPoolGetPacket ( void  )

Get a new packet from the packet pool.

Only allocates from the thread's local stack, or mallocs new packets. If the local stack is empty, first move all the return stack packets to the local stack.

Return values
Packetpointer, or NULL on failure.

Definition at line 185 of file tmqh-packetpool.c.

Referenced by PacketGetFromQueueOrAlloc(), and TmqhInputPacketpool().

Here is the caller graph for this function:

◆ PacketPoolInit()

void PacketPoolInit ( void  )

Definition at line 302 of file tmqh-packetpool.c.

References max_pending_packets.

Referenced by PostRunDeinit().

Here is the caller graph for this function:

◆ PacketPoolInitEmpty()

void PacketPoolInitEmpty ( void  )

Definition at line 287 of file tmqh-packetpool.c.

◆ PacketPoolPostRunmodes()

void PacketPoolPostRunmodes ( void  )

Set the max_pending_return_packets value.

Set it to the max pending packets value, devided by the number of lister threads. Normally, in autofp these are the stream/detect/log worker threads.

The max_pending_return_packets value needs to stay below the packet pool size of the 'producers' (normally pkt capture threads but also flow timeout injection ) to avoid a deadlock where all the 'workers' keep packets in their return pools, while the capture thread can't continue because its pool is empty.

Definition at line 512 of file tmqh-packetpool.c.

References FatalError, max_pending_packets, RESERVED_PACKETS, SC_ERR_INVALID_ARGUMENT, TM_FLAG_DETECT_TM, and TmThreadCountThreadsByTmmFlags().

Here is the call graph for this function:

◆ PacketPoolReturnPacket()

void PacketPoolReturnPacket ( Packet p)

Return packet to Packet pool.

Definition at line 225 of file tmqh-packetpool.c.

Referenced by PacketFreeOrRelease().

Here is the caller graph for this function:

◆ PacketPoolWait()

void PacketPoolWait ( void  )

Definition at line 84 of file tmqh-packetpool.c.

Referenced by ReceiveErfFileLoop(), and ReceivePfringLoop().

Here is the caller graph for this function:

◆ PacketPoolWaitForN()

void PacketPoolWaitForN ( int  n)

Wait until we have the requested amount of packets in the pool.

In some cases waiting for packets is undesirable. Especially when a wait would happen under a lock of some kind, other parts of the engine could have to wait.

This function only returns when at least N packets are in our pool.

If counting in our pool's main stack didn't give us the number we are seeking, we check if the return stack is filled and add those to our main stack. Then we retry.

Parameters
nnumber of packets needed

Definition at line 113 of file tmqh-packetpool.c.

◆ TmqhInputPacketpool()

Packet* TmqhInputPacketpool ( ThreadVars tv)

Definition at line 370 of file tmqh-packetpool.c.

References PacketPoolGetPacket().

Referenced by TmqhPacketpoolRegister().

Here is the call graph for this function:
Here is the caller graph for this function:

◆ TmqhOutputPacketpool()

◆ TmqhPacketpoolRegister()

void TmqhPacketpoolRegister ( void  )

TmqhPacketpoolRegister \initonly.

Definition at line 68 of file tmqh-packetpool.c.

References Tmqh_::InHandler, Tmqh_::name, Tmqh_::OutHandler, TMQH_PACKETPOOL, tmqh_table, TmqhInputPacketpool(), and TmqhOutputPacketpool().

Referenced by TmqhSetup().

Here is the call graph for this function:
Here is the caller graph for this function:

◆ TmqhReleasePacketsToPacketPool()

void TmqhReleasePacketsToPacketPool ( PacketQueue pq)

Release all the packets in the queue back to the packetpool. Mainly used by threads that have failed, and wants to return the packets back to the packetpool.

Parameters
pqPointer to the packetqueue from which the packets have to be returned back to the packetpool
Warning
this function assumes that the pq does not use locking

Definition at line 480 of file tmqh-packetpool.c.

References PacketDequeue(), and TmqhOutputPacketpool().

Here is the call graph for this function:

Variable Documentation

◆ thread_pkt_pool

thread_local PktPool thread_pkt_pool

Definition at line 57 of file tmqh-packetpool.c.