tmqh-packetpool.c File Reference

#include "suricata-common.h"
#include "tmqh-packetpool.h"
#include "tm-queuehandlers.h"
#include "tm-threads.h"
#include "threads.h"
#include "decode.h"
#include "tm-modules.h"
#include "packet.h"
#include "util-profiling.h"
#include "util-validate.h"
#include "action-globals.h"

Include dependency graph for tmqh-packetpool.c:

Go to the source code of this file.

Macros
#define	MAX_PENDING_RETURN_PACKETS   32
#define	RESERVED_PACKETS   10

Functions
void	TmqhPacketpoolRegister (void)
	TmqhPacketpoolRegister \initonly. More...
void	PacketPoolWait (void)
void	PacketPoolWaitForN (int n)
	Wait until we have the requested amount of packets in the pool. More...
Packet *	PacketPoolGetPacket (void)
	Get a new packet from the packet pool. More...
void	PacketPoolReturnPacket (Packet *p)
	Return packet to Packet pool. More...
void	PacketPoolInitEmpty (void)
void	PacketPoolInit (void)
void	PacketPoolDestroy (void)
Packet *	TmqhInputPacketpool (ThreadVars *tv)
void	TmqhOutputPacketpool (ThreadVars *t, Packet *p)
void	TmqhReleasePacketsToPacketPool (PacketQueue *pq)
	Release all the packets in the queue back to the packetpool. Mainly used by threads that have failed, and wants to return the packets back to the packetpool. More...
void	PacketPoolPostRunmodes (void)
	Set the max_pending_return_packets value. More...

Variables
thread_local PktPool	thread_pkt_pool

Detailed Description

Author

Victor Julien victo.nosp@m.r@in.nosp@m.linia.nosp@m.c.ne.nosp@m.t

Packetpool queue handlers. Packet pool is implemented as a stack.

Definition in file tmqh-packetpool.c.

Macro Definition Documentation

MAX_PENDING_RETURN_PACKETS

#define MAX_PENDING_RETURN_PACKETS   32

Definition at line 40 of file tmqh-packetpool.c.

RESERVED_PACKETS

#define RESERVED_PACKETS   10

number of packets to keep reserved when calculating the the pending return packets count. This assumes we need at max 10 packets in one PacketPoolWaitForN call. The actual number is 9 now, so this has a bit of margin.

Definition at line 486 of file tmqh-packetpool.c.

Function Documentation

PacketPoolDestroy()

void PacketPoolDestroy

(

void

)

Definition at line 316 of file tmqh-packetpool.c.

PacketPoolGetPacket()

Packet* PacketPoolGetPacket

(

void

)

Get a new packet from the packet pool.

Only allocates from the thread's local stack, or mallocs new packets. If the local stack is empty, first move all the return stack packets to the local stack.

Return values

Packet

pointer, or NULL on failure.

Definition at line 167 of file tmqh-packetpool.c.

Referenced by FlowForceReassemblyPseudoPacketGet(), PacketGetFromQueueOrAlloc(), and TmqhInputPacketpool().

Here is the caller graph for this function:

PacketPoolInit()

void PacketPoolInit

(

void

)

Definition at line 284 of file tmqh-packetpool.c.

References max_pending_packets.

Referenced by PostRunDeinit().

Here is the caller graph for this function:

PacketPoolInitEmpty()

void PacketPoolInitEmpty

(

void

)

Definition at line 269 of file tmqh-packetpool.c.

PacketPoolPostRunmodes()

void PacketPoolPostRunmodes

(

void

)

Set the max_pending_return_packets value.

Set it to the max pending packets value, devided by the number of lister threads. Normally, in autofp these are the stream/detect/log worker threads.

The max_pending_return_packets value needs to stay below the packet pool size of the 'producers' (normally pkt capture threads but also flow timeout injection ) to avoid a deadlock where all the 'workers' keep packets in their return pools, while the capture thread can't continue because its pool is empty.

Definition at line 500 of file tmqh-packetpool.c.

References FatalError, max_pending_packets, RESERVED_PACKETS, TM_FLAG_DETECT_TM, and TmThreadCountThreadsByTmmFlags().

Here is the call graph for this function:

PacketPoolReturnPacket()

void PacketPoolReturnPacket

(

Packet *

p

)

Return packet to Packet pool.

Definition at line 207 of file tmqh-packetpool.c.

Referenced by PacketFreeOrRelease(), and PacketGetFromQueueOrAlloc().

Here is the caller graph for this function:

PacketPoolWait()

void PacketPoolWait

(

void

)

Definition at line 69 of file tmqh-packetpool.c.

Referenced by FlowForceReassemblyPseudoPacketGet(), ReceiveErfFileLoop(), and ReceivePfringLoop().

Here is the caller graph for this function:

PacketPoolWaitForN()

void PacketPoolWaitForN

(

int

n

)

Wait until we have the requested amount of packets in the pool.

In some cases waiting for packets is undesirable. Especially when a wait would happen under a lock of some kind, other parts of the engine could have to wait.

This function only returns when at least N packets are in our pool.

If counting in our pool's main stack didn't give us the number we are seeking, we check if the return stack is filled and add those to our main stack. Then we retry.

Parameters

n	number of packets needed

Definition at line 98 of file tmqh-packetpool.c.

TmqhInputPacketpool()

Packet* TmqhInputPacketpool

(

ThreadVars *

tv

)

Definition at line 351 of file tmqh-packetpool.c.

References PacketPoolGetPacket().

Referenced by TmqhPacketpoolRegister().

Here is the call graph for this function:

Here is the caller graph for this function:

TmqhOutputPacketpool()

void TmqhOutputPacketpool	(	ThreadVars *	t,
		Packet *	p
	)

Definition at line 356 of file tmqh-packetpool.c.

References Packet_::action, ACTION_DROP, BOOL2STR, IS_TUNNEL_PKT, IS_TUNNEL_PKT_VERDICTED, IS_TUNNEL_ROOT_PKT, lock, PACKET_PROFILING_END, PacketReleaseRefs(), Packet_::persistent, Packet_::pool, Packet_::ReleasePacket, Packet_::root, SCEnter, SCLogDebug, SCReturn, SCSpinlock, SCSpinLock, SCSpinUnlock, SET_TUNNEL_PKT_VERDICTED, TUNNEL_INCR_PKT_RTV_NOLOCK, Packet_::tunnel_lock, TUNNEL_PKT_RTV, and TUNNEL_PKT_TPR.

Referenced by TmqhPacketpoolRegister(), and TmqhReleasePacketsToPacketPool().

Here is the call graph for this function:

Here is the caller graph for this function:

TmqhPacketpoolRegister()

void TmqhPacketpoolRegister

(

void

)

TmqhPacketpoolRegister \initonly.

Definition at line 53 of file tmqh-packetpool.c.

References Tmqh_::InHandler, Tmqh_::name, Tmqh_::OutHandler, TMQH_PACKETPOOL, tmqh_table, TmqhInputPacketpool(), and TmqhOutputPacketpool().

Referenced by TmqhSetup().

Here is the call graph for this function:

Here is the caller graph for this function:

TmqhReleasePacketsToPacketPool()

void TmqhReleasePacketsToPacketPool

(

PacketQueue *

pq

)

Release all the packets in the queue back to the packetpool. Mainly used by threads that have failed, and wants to return the packets back to the packetpool.

Parameters

pq	Pointer to the packetqueue from which the packets have to be returned back to the packetpool

Warning

this function assumes that the pq does not use locking

Definition at line 466 of file tmqh-packetpool.c.

References DEBUG_VALIDATE_BUG_ON, Packet_::flow, PacketDequeue(), and TmqhOutputPacketpool().

Here is the call graph for this function:

Variable Documentation

thread_pkt_pool

thread_local PktPool thread_pkt_pool

Definition at line 42 of file tmqh-packetpool.c.