Home

FMADIO100G Analytics : v581

Performance baselines

GEOIP Stats for all tests

[20211013_125436] ltrace              :  144 | [/mnt/store0/etc/pcap2json_map.geo] Build      : Build: 20210617-21:28:32
[20211013_125436] ltrace              :  144 | [/mnt/store0/etc/pcap2json_map.geo] IPCount    :    6871363
[20211013_125436] ltrace              :  144 | [/mnt/store0/etc/pcap2json_map.geo] AppCount   :   16777216
[20211013_125436] ltrace              :  144 | [/mnt/store0/etc/pcap2json_map.geo] StringLen  : 1073741824

FW:7330 Ver:581

Flows 500K @ 80Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result

  • 53.941 Gbps

  • 38.332 Mpps

pcap2json

[20211013_232122] ltrace              :  144 | [Wed Oct 13 23:21:22 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.088 Process:0.276 Merge:0.098 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  291 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_232127] ltrace              :  144 | [Wed Oct 13 23:21:27 2021]:   5.00 usec/msg  199963 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       2   500000/Snap    0.200M/sec   29.797 Gbps   21.177 Mpps | Read:0.074 Process:0.164 Merge:0.086 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 2035 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    332.153 Kdps    0.360 Gbps]
[20211013_232132] ltrace              :  144 | [Wed Oct 13 23:21:32 2021]:   2.50 usec/msg  399902 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       6   500000/Snap    0.400M/sec   63.984 Gbps   45.471 Mpps | Read:0.052 Process:0.109 Merge:0.057 Output:0.153 JSONDump:0.069 MACTop:0.000 GeoIP:0.023 Send:0.019 ] Push[ESSock:   0 ESCnt: 3830 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    341.813 Kdps    0.371 Gbps]
[20211013_232137] ltrace              :  144 | [Wed Oct 13 23:21:37 2021]:   3.34 usec/msg  299735 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:       9   500000/Snap    0.300M/sec   47.958 Gbps   34.079 Mpps | Read:0.052 Process:0.103 Merge:0.055 Output:0.090 JSONDump:0.041 MACTop:0.000 GeoIP:0.014 Send:0.010 ] Push[ESSock:   0 ESCnt: 5645 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    345.424 Kdps    0.374 Gbps]
[20211013_232142] ltrace              :  144 | [Wed Oct 13 23:21:42 2021]:   2.50 usec/msg  399934 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   500000/Snap    0.400M/sec   63.990 Gbps   45.470 Mpps | Read:0.047 Process:0.092 Merge:0.048 Output:0.103 JSONDump:0.047 MACTop:0.000 GeoIP:0.016 Send:0.013 ] Push[ESSock:   0 ESCnt: 7523 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    357.643 Kdps    0.388 Gbps]
[20211013_232147] ltrace              :  144 | [Wed Oct 13 23:21:47 2021]:   3.34 usec/msg  299760 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      16   500000/Snap    0.300M/sec   47.962 Gbps   34.081 Mpps | Read:0.045 Process:0.086 Merge:0.044 Output:0.103 JSONDump:0.047 MACTop:0.000 GeoIP:0.016 Send:0.013 ] Push[ESSock:   0 ESCnt: 9467 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    370.001 Kdps    0.401 Gbps]
[20211013_232152] ltrace              :  144 | [Wed Oct 13 23:21:52 2021]:   2.50 usec/msg  399702 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      20   500000/Snap    0.400M/sec   63.952 Gbps   45.447 Mpps | Read:0.043 Process:0.082 Merge:0.042 Output:0.110 JSONDump:0.050 MACTop:0.000 GeoIP:0.017 Send:0.014 ] Push[ESSock:   0 ESCnt:11370 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    362.200 Kdps    0.393 Gbps]
[20211013_232157] ltrace              :  144 | [Wed Oct 13 23:21:57 2021]:   2.50 usec/msg  399870 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      24   500000/Snap    0.400M/sec   63.979 Gbps   45.461 Mpps | Read:0.042 Process:0.079 Merge:0.041 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:13309 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    369.210 Kdps    0.400 Gbps]
[20211013_232202] ltrace              :  144 | [Wed Oct 13 23:22:02 2021]:   3.34 usec/msg  299818 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      27   500000/Snap    0.300M/sec   47.971 Gbps   34.099 Mpps | Read:0.041 Process:0.077 Merge:0.039 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:15137 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    347.987 Kdps    0.377 Gbps]

Flows 500K @ 70Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result:

  • 52.685 Gbps

  • 37.440 Mpps

pcap2json

[20211013_231027] ltrace              :  144 | [Wed Oct 13 23:10:27 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.078 Process:0.338 Merge:0.094 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  406 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_231032] ltrace              :  144 | [Wed Oct 13 23:10:32 2021]:   2.50 usec/msg  399789 Msg/sec Ingress[Inflight:   17 Read:0.000 Fwd:0.000] Flow[Snapshot:       4   500000/Snap    0.400M/sec   44.076 Gbps   31.325 Mpps | Read:0.048 Process:0.168 Merge:0.060 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 2920 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    478.752 Kdps    0.519 Gbps]
[20211013_231037] ltrace              :  144 | [Wed Oct 13 23:10:37 2021]:   2.50 usec/msg  399902 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.400M/sec   55.986 Gbps   39.787 Mpps | Read:0.035 Process:0.112 Merge:0.039 Output:0.120 JSONDump:0.053 MACTop:0.000 GeoIP:0.018 Send:0.018 ] Push[ESSock:   0 ESCnt: 4978 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    391.908 Kdps    0.425 Gbps]
[20211013_231042] ltrace              :  144 | [Wed Oct 13 23:10:42 2021]:   2.50 usec/msg  399455 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      12   500000/Snap    0.399M/sec   55.924 Gbps   39.740 Mpps | Read:0.033 Process:0.098 Merge:0.035 Output:0.089 JSONDump:0.040 MACTop:0.000 GeoIP:0.013 Send:0.012 ] Push[ESSock:   0 ESCnt: 7088 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    401.353 Kdps    0.435 Gbps]
[20211013_231047] ltrace              :  144 | [Wed Oct 13 23:10:47 2021]:   2.50 usec/msg  399935 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      16   500000/Snap    0.400M/sec   55.991 Gbps   39.788 Mpps | Read:0.033 Process:0.090 Merge:0.033 Output:0.103 JSONDump:0.046 MACTop:0.000 GeoIP:0.015 Send:0.015 ] Push[ESSock:   0 ESCnt: 9117 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    386.418 Kdps    0.419 Gbps]
[20211013_231052] ltrace              :  144 | [Wed Oct 13 23:10:52 2021]:   3.34 usec/msg  299817 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      19   500000/Snap    0.300M/sec   41.975 Gbps   29.825 Mpps | Read:0.034 Process:0.087 Merge:0.034 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:11112 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    379.782 Kdps    0.412 Gbps]
[20211013_231057] ltrace              :  144 | [Wed Oct 13 23:10:57 2021]:   2.50 usec/msg  399925 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      23   500000/Snap    0.400M/sec   55.990 Gbps   39.785 Mpps | Read:0.033 Process:0.083 Merge:0.032 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:13159 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    389.823 Kdps    0.423 Gbps]
[20211013_231102] ltrace              :  144 | [Wed Oct 13 23:11:02 2021]:   2.51 usec/msg  398961 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      27   500000/Snap    0.399M/sec   55.855 Gbps   39.690 Mpps | Read:0.032 Process:0.079 Merge:0.031 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:15207 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    389.090 Kdps    0.422 Gbps]
[20211013_231107] ltrace              :  144 | [Wed Oct 13 23:11:07 2021]:   2.50 usec/msg  399527 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      31   500000/Snap    0.400M/sec   55.934 Gbps   39.754 Mpps | Read:0.032 Process:0.077 Merge:0.031 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:17287 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    395.719 Kdps    0.429 Gbps]

Flows 500K @ 60Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result:

  • 55.737 Gbps

  • 39.609 Mpps

pcap2json

[20211013_225926] ltrace              :  144 | [Wed Oct 13 22:59:26 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.082 Process:0.279 Merge:0.117 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    6 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_225931] ltrace              :  144 | [Wed Oct 13 22:59:31 2021]:   1.43 usec/msg  699875 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   500000/Snap    0.700M/sec   72.724 Gbps   51.687 Mpps | Read:0.027 Process:0.104 Merge:0.038 Output:0.291 JSONDump:0.120 MACTop:0.000 GeoIP:0.041 Send:0.049 ] Push[ESSock:   0 ESCnt: 3674 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    698.730 Kdps    0.757 Gbps]
[20211013_225936] ltrace              :  144 | [Wed Oct 13 22:59:36 2021]:  10.00 usec/msg   99977 Msg/sec Ingress[Inflight: 4210 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.100M/sec   11.997 Gbps    8.526 Mpps | Read:0.028 Process:0.106 Merge:0.037 Output:0.196 JSONDump:0.085 MACTop:0.000 GeoIP:0.027 Send:0.030 ] Push[ESSock:   0 ESCnt: 6630 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    563.088 Kdps    0.610 Gbps]
[20211013_225941] ltrace              :  144 | [Wed Oct 13 22:59:41 2021]:   1.67 usec/msg  599888 Msg/sec Ingress[Inflight:  429 Read:0.000 Fwd:0.000] Flow[Snapshot:      14   500000/Snap    0.600M/sec   71.987 Gbps   51.151 Mpps | Read:0.022 Process:0.078 Merge:0.027 Output:0.229 JSONDump:0.097 MACTop:0.000 GeoIP:0.033 Send:0.037 ] Push[ESSock:   0 ESCnt: 8942 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    440.241 Kdps    0.477 Gbps]
[20211013_225946] ltrace              :  144 | [Wed Oct 13 22:59:46 2021]:   1.67 usec/msg  599863 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      20   500000/Snap    0.600M/sec   71.984 Gbps   51.153 Mpps | Read:0.020 Process:0.073 Merge:0.023 Output:0.122 JSONDump:0.052 MACTop:0.000 GeoIP:0.018 Send:0.019 ] Push[ESSock:   0 ESCnt:11623 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    510.525 Kdps    0.553 Gbps]
[20211013_225951] ltrace              :  144 | [Wed Oct 13 22:59:51 2021]:   2.00 usec/msg  499914 Msg/sec Ingress[Inflight:   20 Read:0.000 Fwd:0.000] Flow[Snapshot:      25   500000/Snap    0.500M/sec   59.990 Gbps   42.621 Mpps | Read:0.019 Process:0.068 Merge:0.021 Output:0.113 JSONDump:0.048 MACTop:0.000 GeoIP:0.017 Send:0.017 ] Push[ESSock:   0 ESCnt:14065 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    465.047 Kdps    0.504 Gbps]
[20211013_225956] ltrace              :  144 | [Wed Oct 13 22:59:56 2021]:   2.00 usec/msg  499851 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   500000/Snap    0.500M/sec   59.982 Gbps   42.626 Mpps | Read:0.019 Process:0.064 Merge:0.020 Output:0.117 JSONDump:0.050 MACTop:0.000 GeoIP:0.017 Send:0.018 ] Push[ESSock:   0 ESCnt:16602 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    483.078 Kdps    0.524 Gbps]
[20211013_230001] ltrace              :  144 | [Wed Oct 13 23:00:01 2021]:   2.50 usec/msg  399903 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      34   500000/Snap    0.400M/sec   47.989 Gbps   34.108 Mpps | Read:0.019 Process:0.062 Merge:0.020 Output:0.216 JSONDump:0.091 MACTop:0.000 GeoIP:0.032 Send:0.033 ] Push[ESSock:   0 ESCnt:19073 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    470.583 Kdps    0.510 Gbps]
[20211013_230006] ltrace              :  144 | [Wed Oct 13 23:00:06 2021]:   2.02 usec/msg  494328 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      39   500000/Snap    0.494M/sec   59.319 Gbps   42.152 Mpps | Read:0.019 Process:0.060 Merge:0.019 Output:0.103 JSONDump:0.043 MACTop:0.000 GeoIP:0.015 Send:0.016 ] Push[ESSock:   0 ESCnt:21624 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    480.391 Kdps    0.521 Gbps]

Flows 500K @ 50Gbps Profile:SMALL

GEOIP Enable

Output ES NULL

Result

  • 51.910 Gbps

  • 36.887 Mpps

pcap2json

[20211013_225926] ltrace              :  144 | [Wed Oct 13 22:59:26 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.082 Process:0.279 Merge:0.117 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    6 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_225931] ltrace              :  144 | [Wed Oct 13 22:59:31 2021]:   1.43 usec/msg  699875 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   500000/Snap    0.700M/sec   72.724 Gbps   51.687 Mpps | Read:0.027 Process:0.104 Merge:0.038 Output:0.291 JSONDump:0.120 MACTop:0.000 GeoIP:0.041 Send:0.049 ] Push[ESSock:   0 ESCnt: 3674 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    698.730 Kdps    0.757 Gbps]
[20211013_225936] ltrace              :  144 | [Wed Oct 13 22:59:36 2021]:  10.00 usec/msg   99977 Msg/sec Ingress[Inflight: 4210 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.100M/sec   11.997 Gbps    8.526 Mpps | Read:0.028 Process:0.106 Merge:0.037 Output:0.196 JSONDump:0.085 MACTop:0.000 GeoIP:0.027 Send:0.030 ] Push[ESSock:   0 ESCnt: 6630 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    563.088 Kdps    0.610 Gbps]
[20211013_225941] ltrace              :  144 | [Wed Oct 13 22:59:41 2021]:   1.67 usec/msg  599888 Msg/sec Ingress[Inflight:  429 Read:0.000 Fwd:0.000] Flow[Snapshot:      14   500000/Snap    0.600M/sec   71.987 Gbps   51.151 Mpps | Read:0.022 Process:0.078 Merge:0.027 Output:0.229 JSONDump:0.097 MACTop:0.000 GeoIP:0.033 Send:0.037 ] Push[ESSock:   0 ESCnt: 8942 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    440.241 Kdps    0.477 Gbps]
[20211013_225946] ltrace              :  144 | [Wed Oct 13 22:59:46 2021]:   1.67 usec/msg  599863 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      20   500000/Snap    0.600M/sec   71.984 Gbps   51.153 Mpps | Read:0.020 Process:0.073 Merge:0.023 Output:0.122 JSONDump:0.052 MACTop:0.000 GeoIP:0.018 Send:0.019 ] Push[ESSock:   0 ESCnt:11623 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    510.525 Kdps    0.553 Gbps]
[20211013_225951] ltrace              :  144 | [Wed Oct 13 22:59:51 2021]:   2.00 usec/msg  499914 Msg/sec Ingress[Inflight:   20 Read:0.000 Fwd:0.000] Flow[Snapshot:      25   500000/Snap    0.500M/sec   59.990 Gbps   42.621 Mpps | Read:0.019 Process:0.068 Merge:0.021 Output:0.113 JSONDump:0.048 MACTop:0.000 GeoIP:0.017 Send:0.017 ] Push[ESSock:   0 ESCnt:14065 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    465.047 Kdps    0.504 Gbps]
[20211013_225956] ltrace              :  144 | [Wed Oct 13 22:59:56 2021]:   2.00 usec/msg  499851 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   500000/Snap    0.500M/sec   59.982 Gbps   42.626 Mpps | Read:0.019 Process:0.064 Merge:0.020 Output:0.117 JSONDump:0.050 MACTop:0.000 GeoIP:0.017 Send:0.018 ] Push[ESSock:   0 ESCnt:16602 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    483.078 Kdps    0.524 Gbps]
[20211013_230001] ltrace              :  144 | [Wed Oct 13 23:00:01 2021]:   2.50 usec/msg  399903 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      34   500000/Snap    0.400M/sec   47.989 Gbps   34.108 Mpps | Read:0.019 Process:0.062 Merge:0.020 Output:0.216 JSONDump:0.091 MACTop:0.000 GeoIP:0.032 Send:0.033 ] Push[ESSock:   0 ESCnt:19073 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    470.583 Kdps    0.510 Gbps]
[20211013_230006] ltrace              :  144 | [Wed Oct 13 23:00:06 2021]:   2.02 usec/msg  494328 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      39   500000/Snap    0.494M/sec   59.319 Gbps   42.152 Mpps | Read:0.019 Process:0.060 Merge:0.019 Output:0.103 JSONDump:0.043 MACTop:0.000 GeoIP:0.015 Send:0.016 ] Push[ESSock:   0 ESCnt:21624 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    480.391 Kdps    0.521 Gbps]

Flows 1M @ 50Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result:

  • 22.768 Gbps

  • 16.180 Mpps

pcap2json


[20211013_224650] ltrace              :  144 | [Wed Oct 13 22:46:50 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.082 Process:0.261 Merge:0.121 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_224655] ltrace              :  144 | [Wed Oct 13 22:46:55 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 5107 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.081 Process:0.261 Merge:0.121 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_224700] ltrace              :  144 | [Wed Oct 13 22:47:00 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:12145 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.081 Process:0.261 Merge:0.121 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 4119 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    785.273 Kdps    0.851 Gbps]
[20211013_224705] ltrace              :  144 | [Wed Oct 13 22:47:05 2021]:   0.71 usec/msg 1398889 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       7  1000000/Snap    1.399M/sec   61.884 Gbps   43.982 Mpps | Read:0.026 Process:0.106 Merge:0.037 Output:0.098 JSONDump:0.030 MACTop:0.000 GeoIP:0.010 Send:0.017 ] Push[ESSock:   0 ESCnt: 7343 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    614.023 Kdps    0.665 Gbps]
[20211013_224710] ltrace              :  144 | [Wed Oct 13 22:47:10 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 3420 Read:0.000 Fwd:0.000] Flow[Snapshot:       7        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.033 Process:0.123 Merge:0.043 Output:0.098 JSONDump:0.030 MACTop:0.000 GeoIP:0.010 Send:0.017 ] Push[ESSock:   0 ESCnt: 7963 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    118.197 Kdps    0.128 Gbps]
[20211013_224715] ltrace              :  144 | [Wed Oct 13 22:47:15 2021]:   5.00 usec/msg  199966 Msg/sec Ingress[Inflight:10410 Read:0.000 Fwd:0.000] Flow[Snapshot:       8  1000000/Snap    0.200M/sec    9.998 Gbps    7.108 Mpps | Read:0.031 Process:0.119 Merge:0.041 Output:0.116 JSONDump:0.041 MACTop:0.000 GeoIP:0.014 Send:0.017 ] Push[ESSock:   0 ESCnt: 9353 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    264.980 Kdps    0.287 Gbps]
[20211013_224720] ltrace              :  144 | [Wed Oct 13 22:47:20 2021]:   5.00 usec/msg  199956 Msg/sec Ingress[Inflight:14404 Read:0.000 Fwd:0.000] Flow[Snapshot:       9  1000000/Snap    0.200M/sec    9.998 Gbps    7.105 Mpps | Read:0.030 Process:0.111 Merge:0.039 Output:0.214 JSONDump:0.072 MACTop:0.000 GeoIP:0.024 Send:0.033 ] Push[ESSock:   0 ESCnt:13505 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    791.509 Kdps    0.857 Gbps]
[20211013_224725] ltrace              :  144 | [Wed Oct 13 22:47:25 2021]:   1.00 usec/msg  999842 Msg/sec Ingress[Inflight: 4233 Read:0.000 Fwd:0.000] Flow[Snapshot:      14  1000000/Snap    1.000M/sec   49.992 Gbps   35.522 Mpps | Read:0.020 Process:0.094 Merge:0.027 Output:0.524 JSONDump:0.166 MACTop:0.000 GeoIP:0.054 Send:0.077 ] Push[ESSock:   0 ESCnt:15543 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    388.428 Kdps    0.421 Gbps]
[20211013_224730] ltrace              :  144 | [Wed Oct 13 22:47:30 2021]:   5.00 usec/msg  199900 Msg/sec Ingress[Inflight: 9687 Read:0.000 Fwd:0.000] Flow[Snapshot:      15  1000000/Snap    0.200M/sec    9.995 Gbps    7.102 Mpps | Read:0.020 Process:0.092 Merge:0.026 Output:0.532 JSONDump:0.167 MACTop:0.000 GeoIP:0.054 Send:0.078 ] Push[ESSock:   0 ESCnt:17745 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    419.645 Kdps    0.455 Gbps]
[20211013_224735] ltrace              :  144 | [Wed Oct 13 22:47:35 2021]:   5.00 usec/msg  199974 Msg/sec Ingress[Inflight:13895 Read:0.000 Fwd:0.000] Flow[Snapshot:      16  1000000/Snap    0.200M/sec    9.999 Gbps    7.105 Mpps | Read:0.019 Process:0.087 Merge:0.024 Output:0.547 JSONDump:0.168 MACTop:0.000 GeoIP:0.054 Send:0.083 ] Push[ESSock:   0 ESCnt:21781 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    769.478 Kdps    0.833 Gbps]
[20211013_224740] ltrace              :  144 | [Wed Oct 13 22:47:40 2021]:   0.83 usec/msg 1199782 Msg/sec Ingress[Inflight:  908 Read:0.000 Fwd:0.000] Flow[Snapshot:      22  1000000/Snap    1.200M/sec   59.989 Gbps   42.629 Mpps | Read:0.015 Process:0.079 Merge:0.020 Output:0.348 JSONDump:0.109 MACTop:0.000 GeoIP:0.036 Send:0.063 ] Push[ESSock:   0 ESCnt:23326 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    294.390 Kdps    0.319 Gbps]
[20211013_224745] ltrace              :  144 | [Wed Oct 13 22:47:45 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 8312 Read:0.000 Fwd:0.000] Flow[Snapshot:      22        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.015 Process:0.079 Merge:0.020 Output:0.348 JSONDump:0.109 MACTop:0.000 GeoIP:0.036 Send:0.063 ] Push[ESSock:   0 ESCnt:24709 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    263.477 Kdps    0.285 Gbps]
[20211013_224750] ltrace              :  144 | [Wed Oct 13 22:47:50 2021]:   5.00 usec/msg  199898 Msg/sec Ingress[Inflight:13106 Read:0.000 Fwd:0.000] Flow[Snapshot:      23  1000000/Snap    0.200M/sec    9.995 Gbps    7.105 Mpps | Read:0.015 Process:0.078 Merge:0.019 Output:0.354 JSONDump:0.114 MACTop:0.000 GeoIP:0.037 Send:0.063 ] Push[ESSock:   0 ESCnt:28409 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    705.148 Kdps    0.764 Gbps]
[20211013_224755] ltrace              :  144 | [Wed Oct 13 22:47:55 2021]:   1.00 usec/msg  999844 Msg/sec Ingress[Inflight: 2544 Read:0.000 Fwd:0.000] Flow[Snapshot:      28  1000000/Snap    1.000M/sec   49.992 Gbps   35.519 Mpps | Read:0.013 Process:0.077 Merge:0.016 Output:0.348 JSONDump:0.107 MACTop:0.000 GeoIP:0.034 Send:0.064 ] Push[ESSock:   0 ESCnt:31052 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    503.762 Kdps    0.546 Gbps]
[20211013_224800] ltrace              :  144 | [Wed Oct 13 22:48:00 2021]:   2.50 usec/msg  399243 Msg/sec Ingress[Inflight: 7791 Read:0.000 Fwd:0.000] Flow[Snapshot:      30  1000000/Snap    0.399M/sec   19.962 Gbps   14.181 Mpps | Read:0.012 Process:0.071 Merge:0.015 Output:0.462 JSONDump:0.141 MACTop:0.000 GeoIP:0.045 Send:0.083 ] Push[ESSock:   0 ESCnt:32905 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    352.609 Kdps    0.382 Gbps]
[20211013_224805] ltrace              :  144 | [Wed Oct 13 22:48:05 2021]:   5.00 usec/msg  199923 Msg/sec Ingress[Inflight:14177 Read:0.000 Fwd:0.000] Flow[Snapshot:      31  1000000/Snap    0.200M/sec    9.996 Gbps    7.105 Mpps | Read:0.012 Process:0.069 Merge:0.015 Output:0.466 JSONDump:0.144 MACTop:0.000 GeoIP:0.046 Send:0.084 ] Push[ESSock:   0 ESCnt:36173 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    622.888 Kdps    0.675 Gbps]
[20211013_224810] ltrace              :  144 | [Wed Oct 13 22:48:10 2021]:   1.01 usec/msg  994945 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:      36  1000000/Snap    0.995M/sec   49.747 Gbps   35.350 Mpps | Read:0.010 Process:0.066 Merge:0.013 Output:0.480 JSONDump:0.148 MACTop:0.000 GeoIP:0.047 Send:0.088 ] Push[ESSock:   0 ESCnt:39321 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    597.108 Kdps    0.647 Gbps]
[20211013_224815] ltrace              :  144 | [Wed Oct 13 22:48:15 2021]:   2.50 usec/msg  399911 Msg/sec Ingress[Inflight: 6031 Read:0.000 Fwd:0.000] Flow[Snapshot:      38  1000000/Snap    0.400M/sec   19.996 Gbps   14.209 Mpps | Read:0.010 Process:0.065 Merge:0.013 Output:0.486 JSONDump:0.151 MACTop:0.000 GeoIP:0.048 Send:0.090 ] Push[ESSock:   0 ESCnt:41137 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    346.151 Kdps    0.375 Gbps]
[20211013_224820] ltrace              :  144 | [Wed Oct 13 22:48:20 2021]:   2.50 usec/msg  399938 Msg/sec Ingress[Inflight: 9511 Read:0.000 Fwd:0.000] Flow[Snapshot:      40  1000000/Snap    0.400M/sec   19.997 Gbps   14.214 Mpps | Read:0.010 Process:0.063 Merge:0.012 Output:0.492 JSONDump:0.156 MACTop:0.000 GeoIP:0.050 Send:0.091 ] Push[ESSock:   0 ESCnt:43529 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    455.997 Kdps    0.494 Gbps]
[20211013_224825] ltrace              :  144 | [Wed Oct 13 22:48:25 2021]:   5.00 usec/msg  199972 Msg/sec Ingress[Inflight:14791 Read:0.000 Fwd:0.000] Flow[Snapshot:      41  1000000/Snap    0.200M/sec    9.999 Gbps    7.111 Mpps | Read:0.009 Process:0.062 Merge:0.012 Output:0.494 JSONDump:0.157 MACTop:0.000 GeoIP:0.050 Send:0.092 ] Push[ESSock:   0 ESCnt:47351 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    728.638 Kdps    0.789 Gbps]

Flows 800K @ 50Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result

  • 28.115 Gbps

  • 19.98 Mpps

pcap2json

[20211013_223514] ltrace              :  144 | [Wed Oct 13 22:35:14 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.082 Process:0.258 Merge:0.121 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_223519] ltrace              :  144 | [Wed Oct 13 22:35:19 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 6882 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.081 Process:0.265 Merge:0.120 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 1145 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    218.498 Kdps    0.236 Gbps]
[20211013_223524] ltrace              :  144 | [Wed Oct 13 22:35:24 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:14010 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.081 Process:0.265 Merge:0.120 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 5012 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    737.570 Kdps    0.798 Gbps]
[20211013_223529] ltrace              :  144 | [Wed Oct 13 22:35:29 2021]:   0.89 usec/msg 1119821 Msg/sec Ingress[Inflight:  480 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   800000/Snap    1.120M/sec   61.286 Gbps   43.557 Mpps | Read:0.030 Process:0.115 Merge:0.040 Output:0.099 JSONDump:0.029 MACTop:0.000 GeoIP:0.010 Send:0.027 ] Push[ESSock:   0 ESCnt: 6291 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    243.358 Kdps    0.263 Gbps]
[20211013_223534] ltrace              :  144 | [Wed Oct 13 22:35:34 2021]:   6.26 usec/msg  159694 Msg/sec Ingress[Inflight: 9090 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   800000/Snap    0.160M/sec    9.981 Gbps    7.096 Mpps | Read:0.028 Process:0.111 Merge:0.038 Output:0.115 JSONDump:0.041 MACTop:0.000 GeoIP:0.014 Send:0.023 ] Push[ESSock:   0 ESCnt: 8351 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    392.263 Kdps    0.425 Gbps]
[20211013_223539] ltrace              :  144 | [Wed Oct 13 22:35:39 2021]:   1.25 usec/msg  799870 Msg/sec Ingress[Inflight:   17 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   800000/Snap    0.800M/sec   49.992 Gbps   35.520 Mpps | Read:0.021 Process:0.088 Merge:0.028 Output:0.224 JSONDump:0.081 MACTop:0.000 GeoIP:0.026 Send:0.044 ] Push[ESSock:   0 ESCnt:12176 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    729.264 Kdps    0.789 Gbps]
[20211013_223544] ltrace              :  144 | [Wed Oct 13 22:35:44 2021]:   3.13 usec/msg  319940 Msg/sec Ingress[Inflight: 2727 Read:0.000 Fwd:0.000] Flow[Snapshot:      15   800000/Snap    0.320M/sec   19.996 Gbps   14.211 Mpps | Read:0.023 Process:0.092 Merge:0.029 Output:0.109 JSONDump:0.040 MACTop:0.000 GeoIP:0.012 Send:0.022 ] Push[ESSock:   0 ESCnt:13218 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    198.597 Kdps    0.215 Gbps]
[20211013_223549] ltrace              :  144 | [Wed Oct 13 22:35:49 2021]:   6.25 usec/msg  159977 Msg/sec Ingress[Inflight:10762 Read:0.000 Fwd:0.000] Flow[Snapshot:      16   800000/Snap    0.160M/sec    9.999 Gbps    7.106 Mpps | Read:0.023 Process:0.089 Merge:0.028 Output:0.117 JSONDump:0.046 MACTop:0.000 GeoIP:0.014 Send:0.021 ] Push[ESSock:   0 ESCnt:15991 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    529.008 Kdps    0.573 Gbps]
[20211013_223554] ltrace              :  144 | [Wed Oct 13 22:35:54 2021]:   1.04 usec/msg  959848 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:      22   800000/Snap    0.960M/sec   59.991 Gbps   42.629 Mpps | Read:0.019 Process:0.079 Merge:0.024 Output:0.219 JSONDump:0.081 MACTop:0.000 GeoIP:0.025 Send:0.041 ] Push[ESSock:   0 ESCnt:18976 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    568.883 Kdps    0.616 Gbps]
[20211013_223559] ltrace              :  144 | [Wed Oct 13 22:35:59 2021]:   6.25 usec/msg  159976 Msg/sec Ingress[Inflight: 5368 Read:0.000 Fwd:0.000] Flow[Snapshot:      23   800000/Snap    0.160M/sec    9.999 Gbps    7.108 Mpps | Read:0.021 Process:0.081 Merge:0.025 Output:0.225 JSONDump:0.080 MACTop:0.000 GeoIP:0.025 Send:0.040 ] Push[ESSock:   0 ESCnt:19697 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    137.462 Kdps    0.149 Gbps]
[20211013_223604] ltrace              :  144 | [Wed Oct 13 22:36:04 2021]:   6.26 usec/msg  159825 Msg/sec Ingress[Inflight: 9849 Read:0.000 Fwd:0.000] Flow[Snapshot:      24   800000/Snap    0.160M/sec    9.989 Gbps    7.096 Mpps | Read:0.020 Process:0.078 Merge:0.025 Output:0.233 JSONDump:0.082 MACTop:0.000 GeoIP:0.026 Send:0.040 ] Push[ESSock:   0 ESCnt:23090 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    646.682 Kdps    0.700 Gbps]
[20211013_223609] ltrace              :  144 | [Wed Oct 13 22:36:09 2021]:   1.05 usec/msg  953850 Msg/sec Ingress[Inflight: 1269 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   800000/Snap    0.954M/sec   59.615 Gbps   42.355 Mpps | Read:0.018 Process:0.077 Merge:0.021 Output:0.210 JSONDump:0.068 MACTop:0.000 GeoIP:0.022 Send:0.042 ] Push[ESSock:   0 ESCnt:25953 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    542.206 Kdps    0.587 Gbps]
[20211013_223614] ltrace              :  144 | [Wed Oct 13 22:36:14 2021]:   6.25 usec/msg  159976 Msg/sec Ingress[Inflight: 7986 Read:0.000 Fwd:0.000] Flow[Snapshot:      31   800000/Snap    0.160M/sec    9.999 Gbps    7.109 Mpps | Read:0.017 Process:0.075 Merge:0.021 Output:0.215 JSONDump:0.071 MACTop:0.000 GeoIP:0.023 Send:0.042 ] Push[ESSock:   0 ESCnt:27735 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    339.891 Kdps    0.368 Gbps]
[20211013_223619] ltrace              :  144 | [Wed Oct 13 22:36:19 2021]:   1.56 usec/msg  639862 Msg/sec Ingress[Inflight: 3500 Read:0.000 Fwd:0.000] Flow[Snapshot:      35   800000/Snap    0.640M/sec   39.991 Gbps   28.420 Mpps | Read:0.016 Process:0.072 Merge:0.019 Output:0.341 JSONDump:0.116 MACTop:0.000 GeoIP:0.038 Send:0.064 ] Push[ESSock:   0 ESCnt:30964 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    615.636 Kdps    0.666 Gbps]
[20211013_223624] ltrace              :  144 | [Wed Oct 13 22:36:24 2021]:   2.08 usec/msg  479775 Msg/sec Ingress[Inflight: 5526 Read:0.000 Fwd:0.000] Flow[Snapshot:      38   800000/Snap    0.480M/sec   29.987 Gbps   21.305 Mpps | Read:0.015 Process:0.072 Merge:0.018 Output:0.577 JSONDump:0.195 MACTop:0.000 GeoIP:0.062 Send:0.102 ] Push[ESSock:   0 ESCnt:33542 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    491.418 Kdps    0.532 Gbps]
[20211013_223629] ltrace              :  144 | [Wed Oct 13 22:36:29 2021]:   2.09 usec/msg  479532 Msg/sec Ingress[Inflight:10540 Read:0.000 Fwd:0.000] Flow[Snapshot:      41   800000/Snap    0.480M/sec   29.971 Gbps   21.304 Mpps | Read:0.014 Process:0.069 Merge:0.017 Output:0.692 JSONDump:0.237 MACTop:0.000 GeoIP:0.075 Send:0.123 ] Push[ESSock:   0 ESCnt:36413 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    547.021 Kdps    0.592 Gbps]

Flows 700K @ 50Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result

  • 31.823Gbps

  • 22.614Mpps

pcap2json

[20211013_222345] Flow_Template       :  531 |  48 : [}}] SUFFIX : 58
[20211013_222349] ltrace              :  144 | [Wed Oct 13 22:23:49 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.082 Process:0.273 Merge:0.115 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_222354] ltrace              :  144 | [Wed Oct 13 22:23:54 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 8242 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.082 Process:0.274 Merge:0.115 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 2446 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    466.579 Kdps    0.505 Gbps]
[20211013_222359] ltrace              :  144 | [Wed Oct 13 22:23:59 2021]:   1.02 usec/msg  979801 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   700000/Snap    0.980M/sec   65.604 Gbps   46.626 Mpps | Read:0.027 Process:0.118 Merge:0.036 Output:0.098 JSONDump:0.035 MACTop:0.000 GeoIP:0.012 Send:0.018 ] Push[ESSock:   0 ESCnt: 5256 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    535.694 Kdps    0.580 Gbps]
[20211013_222404] ltrace              :  144 | [Wed Oct 13 22:24:04 2021]:   7.16 usec/msg  139655 Msg/sec Ingress[Inflight: 7359 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   700000/Snap    0.140M/sec    9.975 Gbps    7.091 Mpps | Read:0.028 Process:0.122 Merge:0.036 Output:0.115 JSONDump:0.046 MACTop:0.000 GeoIP:0.016 Send:0.017 ] Push[ESSock:   0 ESCnt: 6887 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    310.385 Kdps    0.336 Gbps]
[20211013_222409] ltrace              :  144 | [Wed Oct 13 22:24:09 2021]:   1.43 usec/msg  698556 Msg/sec Ingress[Inflight:   22 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   700000/Snap    0.699M/sec   49.897 Gbps   35.454 Mpps | Read:0.021 Process:0.095 Merge:0.027 Output:0.424 JSONDump:0.160 MACTop:0.000 GeoIP:0.053 Send:0.069 ] Push[ESSock:   0 ESCnt:10587 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    704.267 Kdps    0.762 Gbps]
[20211013_222414] ltrace              :  144 | [Wed Oct 13 22:24:14 2021]:   3.58 usec/msg  279640 Msg/sec Ingress[Inflight: 6202 Read:0.000 Fwd:0.000] Flow[Snapshot:      15   700000/Snap    0.280M/sec   19.975 Gbps   14.194 Mpps | Read:0.021 Process:0.094 Merge:0.026 Output:0.225 JSONDump:0.088 MACTop:0.000 GeoIP:0.029 Send:0.036 ] Push[ESSock:   0 ESCnt:12138 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    295.456 Kdps    0.320 Gbps]
[20211013_222419] ltrace              :  144 | [Wed Oct 13 22:24:19 2021]:   3.57 usec/msg  279953 Msg/sec Ingress[Inflight: 9910 Read:0.000 Fwd:0.000] Flow[Snapshot:      17   700000/Snap    0.280M/sec   19.997 Gbps   14.209 Mpps | Read:0.020 Process:0.088 Merge:0.024 Output:0.345 JSONDump:0.135 MACTop:0.000 GeoIP:0.044 Send:0.056 ] Push[ESSock:   0 ESCnt:15856 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    709.167 Kdps    0.768 Gbps]
[20211013_222424] ltrace              :  144 | [Wed Oct 13 22:24:24 2021]:   1.19 usec/msg  839878 Msg/sec Ingress[Inflight: 1268 Read:0.000 Fwd:0.000] Flow[Snapshot:      23   700000/Snap    0.840M/sec   59.991 Gbps   42.634 Mpps | Read:0.019 Process:0.078 Merge:0.023 Output:0.109 JSONDump:0.040 MACTop:0.000 GeoIP:0.013 Send:0.019 ] Push[ESSock:   0 ESCnt:17333 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    281.500 Kdps    0.305 Gbps]
[20211013_222429] ltrace              :  144 | [Wed Oct 13 22:24:29 2021]:   7.14 usec/msg  139976 Msg/sec Ingress[Inflight: 9621 Read:0.000 Fwd:0.000] Flow[Snapshot:      24   700000/Snap    0.140M/sec    9.999 Gbps    7.101 Mpps | Read:0.019 Process:0.077 Merge:0.022 Output:0.115 JSONDump:0.043 MACTop:0.000 GeoIP:0.014 Send:0.019 ] Push[ESSock:   0 ESCnt:19714 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    454.176 Kdps    0.492 Gbps]
[20211013_222434] ltrace              :  144 | [Wed Oct 13 22:24:34 2021]:   1.19 usec/msg  839824 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   700000/Snap    0.840M/sec   59.988 Gbps   42.624 Mpps | Read:0.016 Process:0.070 Merge:0.019 Output:0.237 JSONDump:0.089 MACTop:0.000 GeoIP:0.029 Send:0.041 ] Push[ESSock:   0 ESCnt:22632 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    556.349 Kdps    0.602 Gbps]
[20211013_222439] ltrace              :  144 | [Wed Oct 13 22:24:39 2021]:   7.14 usec/msg  139974 Msg/sec Ingress[Inflight: 5550 Read:0.000 Fwd:0.000] Flow[Snapshot:      31   700000/Snap    0.140M/sec    9.998 Gbps    7.104 Mpps | Read:0.018 Process:0.072 Merge:0.021 Output:0.122 JSONDump:0.046 MACTop:0.000 GeoIP:0.015 Send:0.022 ] Push[ESSock:   0 ESCnt:23613 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    187.095 Kdps    0.203 Gbps]
[20211013_222444] ltrace              :  144 | [Wed Oct 13 22:24:44 2021]:   7.15 usec/msg  139913 Msg/sec Ingress[Inflight:11596 Read:0.000 Fwd:0.000] Flow[Snapshot:      32   700000/Snap    0.140M/sec    9.994 Gbps    7.105 Mpps | Read:0.018 Process:0.071 Merge:0.021 Output:0.125 JSONDump:0.048 MACTop:0.000 GeoIP:0.016 Send:0.022 ] Push[ESSock:   0 ESCnt:26964 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    638.922 Kdps    0.692 Gbps]
[20211013_222449] ltrace              :  144 | [Wed Oct 13 22:24:49 2021]:   1.02 usec/msg  979845 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:      39   700000/Snap    0.980M/sec   69.989 Gbps   49.734 Mpps | Read:0.017 Process:0.071 Merge:0.020 Output:0.120 JSONDump:0.045 MACTop:0.000 GeoIP:0.014 Send:0.024 ] Push[ESSock:   0 ESCnt:29101 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    407.349 Kdps    0.441 Gbps]
[20211013_222454] ltrace              :  144 | [Wed Oct 13 22:24:54 2021]:   7.14 usec/msg  139976 Msg/sec Ingress[Inflight: 7974 Read:0.000 Fwd:0.000] Flow[Snapshot:      40   700000/Snap    0.140M/sec    9.998 Gbps    7.108 Mpps | Read:0.017 Process:0.070 Merge:0.020 Output:0.122 JSONDump:0.047 MACTop:0.000 GeoIP:0.015 Send:0.024 ] Push[ESSock:   0 ESCnt:31064 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    374.424 Kdps    0.405 Gbps]
[20211013_222458] ltrace              :  144 | [reader thread 0] no more data, exiting Lines:39900000 Blocks:38965

Flows 600K @ 50Gbps Profile: SMALL

GEOIP Enable

Output ESNULL

Result:

  • 42.069Gbps

  • 29.895Mpps

pcap2json

[20211013_221321] ltrace              :  144 | [Wed Oct 13 22:13:21 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 2679 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.081 Process:0.282 Merge:0.114 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_221326] ltrace              :  144 | [Wed Oct 13 22:13:26 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:10201 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.081 Process:0.282 Merge:0.114 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 3602 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    686.572 Kdps    0.743 Gbps]
[20211013_221331] ltrace              :  144 | [Wed Oct 13 22:13:31 2021]:   1.19 usec/msg  839799 Msg/sec Ingress[Inflight: 6080 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   600000/Snap    0.840M/sec   69.215 Gbps   49.195 Mpps | Read:0.029 Process:0.124 Merge:0.037 Output:0.098 JSONDump:0.036 MACTop:0.000 GeoIP:0.013 Send:0.019 ] Push[ESSock:   0 ESCnt: 5049 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    274.778 Kdps    0.298 Gbps]
[20211013_221336] ltrace              :  144 | [Wed Oct 13 22:13:36 2021]:   1.39 usec/msg  719857 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   600000/Snap    0.720M/sec   59.989 Gbps   42.626 Mpps | Read:0.020 Process:0.101 Merge:0.025 Output:0.437 JSONDump:0.174 MACTop:0.000 GeoIP:0.057 Send:0.069 ] Push[ESSock:   0 ESCnt: 8899 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    733.208 Kdps    0.794 Gbps]
[20211013_221341] ltrace              :  144 | [Wed Oct 13 22:13:41 2021]:   4.17 usec/msg  239958 Msg/sec Ingress[Inflight: 5922 Read:0.000 Fwd:0.000] Flow[Snapshot:      15   600000/Snap    0.240M/sec   19.996 Gbps   14.209 Mpps | Read:0.019 Process:0.096 Merge:0.024 Output:0.122 JSONDump:0.051 MACTop:0.000 GeoIP:0.017 Send:0.018 ] Push[ESSock:   0 ESCnt:11007 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    401.672 Kdps    0.435 Gbps]
[20211013_221346] ltrace              :  144 | [Wed Oct 13 22:13:46 2021]:   1.39 usec/msg  719871 Msg/sec Ingress[Inflight:  355 Read:0.000 Fwd:0.000] Flow[Snapshot:      21   600000/Snap    0.720M/sec   59.989 Gbps   42.628 Mpps | Read:0.016 Process:0.082 Merge:0.019 Output:0.122 JSONDump:0.051 MACTop:0.000 GeoIP:0.017 Send:0.018 ] Push[ESSock:   0 ESCnt:13919 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    554.342 Kdps    0.600 Gbps]
[20211013_221351] ltrace              :  144 | [Wed Oct 13 22:13:51 2021]:   4.17 usec/msg  239956 Msg/sec Ingress[Inflight: 5930 Read:0.000 Fwd:0.000] Flow[Snapshot:      23   600000/Snap    0.240M/sec   19.996 Gbps   14.211 Mpps | Read:0.015 Process:0.077 Merge:0.018 Output:0.235 JSONDump:0.092 MACTop:0.000 GeoIP:0.032 Send:0.041 ] Push[ESSock:   0 ESCnt:16772 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    543.734 Kdps    0.589 Gbps]
[20211013_221356] ltrace              :  144 | [Wed Oct 13 22:13:56 2021]:   1.39 usec/msg  719893 Msg/sec Ingress[Inflight: 3412 Read:0.000 Fwd:0.000] Flow[Snapshot:      29   600000/Snap    0.720M/sec   59.991 Gbps   42.622 Mpps | Read:0.013 Process:0.075 Merge:0.016 Output:0.336 JSONDump:0.128 MACTop:0.000 GeoIP:0.042 Send:0.063 ] Push[ESSock:   0 ESCnt:19061 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    435.565 Kdps    0.472 Gbps]
[20211013_221401] ltrace              :  144 | [Wed Oct 13 22:14:01 2021]:   2.78 usec/msg  359914 Msg/sec Ingress[Inflight: 3970 Read:0.000 Fwd:0.000] Flow[Snapshot:      32   600000/Snap    0.360M/sec   29.993 Gbps   21.321 Mpps | Read:0.012 Process:0.070 Merge:0.015 Output:0.349 JSONDump:0.134 MACTop:0.000 GeoIP:0.045 Send:0.066 ] Push[ESSock:   0 ESCnt:22536 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    662.148 Kdps    0.717 Gbps]
[20211013_221406] ltrace              :  144 | [Wed Oct 13 22:14:06 2021]:   1.67 usec/msg  598324 Msg/sec Ingress[Inflight: 6523 Read:0.000 Fwd:0.000] Flow[Snapshot:      37   600000/Snap    0.598M/sec   49.860 Gbps   35.426 Mpps | Read:0.012 Process:0.068 Merge:0.014 Output:0.235 JSONDump:0.089 MACTop:0.000 GeoIP:0.030 Send:0.046 ] Push[ESSock:   0 ESCnt:24679 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    406.797 Kdps    0.441 Gbps]
[20211013_221411] ltrace              :  144 | [Wed Oct 13 22:14:11 2021]:   1.19 usec/msg  839662 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      44   600000/Snap    0.840M/sec   69.972 Gbps   49.735 Mpps | Read:0.010 Process:0.064 Merge:0.012 Output:0.478 JSONDump:0.181 MACTop:0.000 GeoIP:0.060 Send:0.090 ] Push[ESSock:   0 ESCnt:28238 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    677.407 Kdps    0.734 Gbps]
[20211013_221416] ltrace              :  144 | [Wed Oct 13 22:14:16 2021]:   4.17 usec/msg  239947 Msg/sec Ingress[Inflight: 5587 Read:0.000 Fwd:0.000] Flow[Snapshot:      46   600000/Snap    0.240M/sec   19.996 Gbps   14.202 Mpps | Read:0.010 Process:0.062 Merge:0.012 Output:0.483 JSONDump:0.183 MACTop:0.000 GeoIP:0.060 Send:0.091 ] Push[ESSock:   0 ESCnt:31232 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    570.606 Kdps    0.618 Gbps]

Flows 500K @ 50Gbps Profile: SMALL

GEOIP enable

Output: ESNULL

Result:

  • 51.99Gbps

  • 36.945Mpps

Flow Generation

 sudo ./pcap_genflow  --pktcnt 4e9 --pktslice 192 --flowcnt 500e3 --bps 50e9 --small |sudo stream_upload --name flow500K_small_50G

pcap2json

[20211013_203149] ltrace              :  144 | [Wed Oct 13 20:31:49 2021]:   5.00 usec/msg  199881 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       2   500000/Snap    0.200M/sec   10.813 Gbps    7.686 Mpps | Read:0.041 Process:0.185 Merge:0.138 Output:0.070 JSONDump:0.032 MACTop:0.000 GeoIP:0.000 Send:0.011 ] Push[ESSock:   0 ESCnt: 1754 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    363.417 Kdps    0.362 Gbps]
[20211013_203154] ltrace              :  144 | [Wed Oct 13 20:31:54 2021]:   1.67 usec/msg  599859 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.600M/sec   59.986 Gbps   42.633 Mpps | Read:0.031 Process:0.144 Merge:0.096 Output:0.258 JSONDump:0.114 MACTop:0.000 GeoIP:0.000 Send:0.043 ] Push[ESSock:   0 ESCnt: 4359 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    539.109 Kdps    0.537 Gbps]
[20211013_203159] ltrace              :  144 | [Wed Oct 13 20:31:59 2021]:   2.00 usec/msg  499911 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   500000/Snap    0.500M/sec   49.991 Gbps   35.523 Mpps | Read:0.028 Process:0.129 Merge:0.080 Output:0.098 JSONDump:0.043 MACTop:0.000 GeoIP:0.000 Send:0.017 ] Push[ESSock:   0 ESCnt: 7115 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    570.620 Kdps    0.568 Gbps]
[20211013_203204] ltrace              :  144 | [Wed Oct 13 20:32:04 2021]:   1.67 usec/msg  599727 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      19   500000/Snap    0.600M/sec   59.973 Gbps   42.619 Mpps | Read:0.026 Process:0.118 Merge:0.070 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 9797 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    554.950 Kdps    0.553 Gbps]
[20211013_203209] ltrace              :  144 | [Wed Oct 13 20:32:09 2021]:   1.67 usec/msg  598039 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:      25   500000/Snap    0.598M/sec   59.804 Gbps   42.493 Mpps | Read:0.025 Process:0.110 Merge:0.062 Output:0.133 JSONDump:0.058 MACTop:0.000 GeoIP:0.000 Send:0.024 ] Push[ESSock:   0 ESCnt:12448 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    546.982 Kdps    0.545 Gbps]
[20211013_203214] ltrace              :  144 | [Wed Oct 13 20:32:14 2021]:   2.00 usec/msg  499916 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   500000/Snap    0.500M/sec   49.991 Gbps   35.519 Mpps | Read:0.025 Process:0.106 Merge:0.058 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:15153 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    560.050 Kdps    0.558 Gbps]
[20211013_203219] ltrace              :  144 | [Wed Oct 13 20:32:19 2021]:   1.67 usec/msg  599888 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      36   500000/Snap    0.600M/sec   59.989 Gbps   42.632 Mpps | Read:0.024 Process:0.102 Merge:0.054 Output:0.094 JSONDump:0.041 MACTop:0.000 GeoIP:0.000 Send:0.016 ] Push[ESSock:   0 ESCnt:17844 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    556.966 Kdps    0.555 Gbps]
[20211013_203224] ltrace              :  144 | [Wed Oct 13 20:32:24 2021]:   2.00 usec/msg  499864 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:      41   500000/Snap    0.500M/sec   49.987 Gbps   35.528 Mpps | Read:0.024 Process:0.101 Merge:0.052 Output:0.221 JSONDump:0.097 MACTop:0.000 GeoIP:0.000 Send:0.039 ] Push[ESSock:   0 ESCnt:20530 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    556.053 Kdps    0.554 Gbps]
[20211013_203229] ltrace              :  144 | [Wed Oct 13 20:32:29 2021]:   1.67 usec/msg  599866 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      47   500000/Snap    0.600M/sec   59.986 Gbps   42.625 Mpps | Read:0.023 Process:0.098 Merge:0.050 Output:0.066 JSONDump:0.029 MACTop:0.000 GeoIP:0.000 Send:0.012 ] Push[ESSock:   0 ESCnt:23163 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    544.920 Kdps    0.543 Gbps]
[20211013_203234] ltrace              :  144 | [Wed Oct 13 20:32:34 2021]:   2.00 usec/msg  499908 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      52   500000/Snap    0.500M/sec   49.991 Gbps   35.528 Mpps | Read:0.023 Process:0.096 Merge:0.049 Output:0.160 JSONDump:0.071 MACTop:0.000 GeoIP:0.000 Send:0.030 ] Push[ESSock:   0 ESCnt:25731 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    531.636 Kdps    0.530 Gbps]
[20211013_203239] ltrace              :  144 | [Wed Oct 13 20:32:39 2021]:   2.00 usec/msg  499924 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:      57   500000/Snap    0.500M/sec   49.992 Gbps   35.529 Mpps | Read:0.023 Process:0.095 Merge:0.047 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:28351 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    542.432 Kdps    0.540 Gbps]
[20211013_203244] ltrace              :  144 | [Wed Oct 13 20:32:44 2021]:   1.67 usec/msg  599852 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:      63   500000/Snap    0.600M/sec   59.985 Gbps   42.630 Mpps | Read:0.022 Process:0.093 Merge:0.046 Output:0.076 JSONDump:0.033 MACTop:0.000 GeoIP:0.000 Send:0.015 ] Push[ESSock:   0 ESCnt:30959 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    539.724 Kdps    0.538 Gbps]
[20211013_203249] ltrace              :  144 | [Wed Oct 13 20:32:49 2021]:   1.67 usec/msg  599906 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:      69   500000/Snap    0.600M/sec   59.990 Gbps   42.623 Mpps | Read:0.022 Process:0.092 Merge:0.045 Output:0.070 JSONDump:0.030 MACTop:0.000 GeoIP:0.000 Send:0.014 ] Push[ESSock:   0 ESCnt:33745 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    576.682 Kdps    0.574 Gbps]
[20211013_203254] ltrace              :  144 | [Wed Oct 13 20:32:54 2021]:   2.00 usec/msg  499906 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      74   500000/Snap    0.500M/sec   49.991 Gbps   35.523 Mpps | Read:0.022 Process:0.091 Merge:0.044 Output:0.073 JSONDump:0.031 MACTop:0.000 GeoIP:0.000 Send:0.015 ] Push[ESSock:   0 ESCnt:36317 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    532.461 Kdps    0.530 Gbps]
[20211013_203259] ltrace              :  144 | [Wed Oct 13 20:32:59 2021]:   2.01 usec/msg  498667 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:      79   500000/Snap    0.499M/sec   49.867 Gbps   35.427 Mpps | Read:0.022 Process:0.091 Merge:0.043 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:39011 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    556.377 Kdps    0.554 Gbps]
[20211013_203304] ltrace              :  144 | [Wed Oct 13 20:33:04 2021]:   1.67 usec/msg  598637 Msg/sec Ingress[Inflight:    9 Read:0.000 Fwd:0.000] Flow[Snapshot:      85   500000/Snap    0.599M/sec   59.864 Gbps   42.539 Mpps | Read:0.021 Process:0.089 Merge:0.042 Output:0.084 JSONDump:0.036 MACTop:0.000 GeoIP:0.000 Send:0.018 ] Push[ESSock:   0 ESCnt:41589 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    532.422 Kdps    0.530 Gbps]
[20211013_203309] ltrace              :  144 | [Wed Oct 13 20:33:09 2021]:   2.00 usec/msg  499836 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      90   500000/Snap    0.500M/sec   49.984 Gbps   35.511 Mpps | Read:0.021 Process:0.089 Merge:0.042 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:44355 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    572.606 Kdps    0.570 Gbps]
[20211013_203314] ltrace              :  144 | [Wed Oct 13 20:33:14 2021]:   1.67 usec/msg  599798 Msg/sec Ingress[Inflight:   11 Read:0.000 Fwd:0.000] Flow[Snapshot:      96   500000/Snap    0.600M/sec   59.980 Gbps   42.622 Mpps | Read:0.021 Process:0.088 Merge:0.041 Output:0.175 JSONDump:0.075 MACTop:0.000 GeoIP:0.000 Send:0.037 ] Push[ESSock:   0 ESCnt:46986 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    544.442 Kdps    0.542 Gbps]

[20211013_203327] ltrace              :  144 | FlowTotal DocsPerSec : 526.470 K Capture: 51.992 Gbps 36.945 Mpps

Flows 500K @ 50Gbps Profile: IMIX

GEOIP Enable

Output: ES NULL

Result

  • 79.9 Gbps

  • 28.21 Mpps

Flow generation

 ./pcap_genflow --pktcnt 1e9 --flowcnt 500e3 --imix --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json500K_50G

pcap2json

[20211013_144709] ltrace              :  144 | [Wed Oct 13 14:47:09 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.095 Process:0.172 Merge:0.161 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_144714] ltrace              :  144 | [Wed Oct 13 14:47:14 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight: 6942 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.091 Process:0.214 Merge:0.152 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 2471 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    471.048 Kdps    0.510 Gbps]
[20211013_144719] ltrace              :  144 | [Wed Oct 13 14:47:19 2021]:   1.43 usec/msg  699834 Msg/sec Ingress[Inflight: 6598 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   500000/Snap    0.700M/sec   63.420 Gbps   22.373 Mpps | Read:0.039 Process:0.138 Merge:0.065 Output:0.143 JSONDump:0.068 MACTop:0.000 GeoIP:0.024 Send:0.009 ] Push[ESSock:   0 ESCnt: 5276 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    534.082 Kdps    0.579 Gbps]
[20211013_144724] ltrace              :  144 | [Wed Oct 13 14:47:24 2021]:   1.43 usec/msg  699878 Msg/sec Ingress[Inflight: 5638 Read:0.000 Fwd:0.000] Flow[Snapshot:      14   500000/Snap    0.700M/sec   69.988 Gbps   24.690 Mpps | Read:0.027 Process:0.109 Merge:0.046 Output:0.294 JSONDump:0.138 MACTop:0.000 GeoIP:0.047 Send:0.020 ] Push[ESSock:   0 ESCnt: 8910 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    692.079 Kdps    0.750 Gbps]
[20211013_144729] ltrace              :  144 | [Wed Oct 13 14:47:29 2021]:   1.25 usec/msg  799884 Msg/sec Ingress[Inflight: 5038 Read:0.000 Fwd:0.000] Flow[Snapshot:      22   500000/Snap    0.800M/sec   79.989 Gbps   28.218 Mpps | Read:0.021 Process:0.095 Merge:0.036 Output:0.328 JSONDump:0.154 MACTop:0.000 GeoIP:0.053 Send:0.023 ] Push[ESSock:   0 ESCnt:12622 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    706.885 Kdps    0.766 Gbps]
[20211013_144734] ltrace              :  144 | [Wed Oct 13 14:47:34 2021]:   1.25 usec/msg  799838 Msg/sec Ingress[Inflight:  675 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   500000/Snap    0.800M/sec   79.984 Gbps   28.216 Mpps | Read:0.017 Process:0.084 Merge:0.029 Output:0.334 JSONDump:0.157 MACTop:0.000 GeoIP:0.054 Send:0.024 ] Push[ESSock:   0 ESCnt:16589 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    755.430 Kdps    0.819 Gbps]
[20211013_144739] ltrace              :  144 | [Wed Oct 13 14:47:39 2021]:   1.25 usec/msg  799608 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:      38   500000/Snap    0.800M/sec   79.961 Gbps   28.208 Mpps | Read:0.015 Process:0.077 Merge:0.025 Output:0.335 JSONDump:0.155 MACTop:0.000 GeoIP:0.053 Send:0.024 ] Push[ESSock:   0 ESCnt:20500 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    744.553 Kdps    0.807 Gbps]
[20211013_144744] ltrace              :  144 | [Wed Oct 13 14:47:44 2021]:   1.25 usec/msg  799888 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      46   500000/Snap    0.800M/sec   79.989 Gbps   28.218 Mpps | Read:0.013 Process:0.072 Merge:0.022 Output:0.576 JSONDump:0.268 MACTop:0.000 GeoIP:0.090 Send:0.041 ] Push[ESSock:   0 ESCnt:24416 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    745.765 Kdps    0.808 Gbps]

FW:7003 Ver:581

Flows 500K @ 50Gbps Profile:IMIX

GEOIP Enable

Output: ES NULL

Result:

  • Data rate 69.98Gbps

  • Packet rate 28.18Mpps

Flow generation

 ./pcap_genflow --pktcnt 1e9 --flowcnt 500e3 --imix --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json500K_50G

Capture size

 [1100] pcap2json500K_50G_20211013_1151     99GB Chunk(Cnt:  407008 Start: 2091208 End: 2498215 Comp:0.00) Inv:-nan Cap:-nan CacheI:-nan Cache:-nan Disk:-nan Drop:-nan Pkt:0

Backend performance

[20211013_133739] ltrace              :  144 | [Wed Oct 13 13:37:39 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:  872 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.083 Process:0.260 Merge:0.121 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_133744] ltrace              :  144 | [Wed Oct 13 13:37:44 2021]:   1.43 usec/msg  698188 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       7   500000/Snap    0.698M/sec   63.271 Gbps   22.320 Mpps | Read:0.029 Process:0.109 Merge:0.042 Output:0.092 JSONDump:0.035 MACTop:0.000 GeoIP:0.012 Send:0.018 ] Push[ESSock:   0 ESCnt: 3722 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    707.313 Kdps    0.766 Gbps]
[20211013_133749] ltrace              :  144 | [Wed Oct 13 13:37:49 2021]:  10.00 usec/msg   99961 Msg/sec Ingress[Inflight: 8826 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.100M/sec    9.996 Gbps    3.526 Mpps | Read:0.029 Process:0.113 Merge:0.040 Output:0.112 JSONDump:0.045 MACTop:0.000 GeoIP:0.016 Send:0.020 ] Push[ESSock:   0 ESCnt: 6998 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    624.097 Kdps    0.676 Gbps]
[20211013_133754] ltrace              :  144 | [Wed Oct 13 13:37:54 2021]:   1.43 usec/msg  699865 Msg/sec Ingress[Inflight: 7082 Read:0.000 Fwd:0.000] Flow[Snapshot:      15   500000/Snap    0.700M/sec   69.987 Gbps   24.690 Mpps | Read:0.021 Process:0.090 Merge:0.028 Output:0.221 JSONDump:0.089 MACTop:0.000 GeoIP:0.031 Send:0.040 ] Push[ESSock:   0 ESCnt: 9863 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    545.514 Kdps    0.591 Gbps]
[20211013_133759] ltrace              :  144 | [Wed Oct 13 13:37:59 2021]:   1.25 usec/msg  799257 Msg/sec Ingress[Inflight: 4279 Read:0.000 Fwd:0.000] Flow[Snapshot:      23   500000/Snap    0.799M/sec   79.926 Gbps   28.196 Mpps | Read:0.018 Process:0.077 Merge:0.023 Output:0.340 JSONDump:0.143 MACTop:0.000 GeoIP:0.046 Send:0.058 ] Push[ESSock:   0 ESCnt:12735 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    546.370 Kdps    0.592 Gbps]
[20211013_133804] ltrace              :  144 | [Wed Oct 13 13:38:04 2021]:   1.43 usec/msg  697477 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      30   500000/Snap    0.697M/sec   69.748 Gbps   24.605 Mpps | Read:0.015 Process:0.070 Merge:0.019 Output:0.462 JSONDump:0.196 MACTop:0.000 GeoIP:0.063 Send:0.077 ] Push[ESSock:   0 ESCnt:16603 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    734.131 Kdps    0.796 Gbps]
[20211013_133809] ltrace              :  144 | [Wed Oct 13 13:38:09 2021]:   3.33 usec/msg  299939 Msg/sec Ingress[Inflight: 8518 Read:0.000 Fwd:0.000] Flow[Snapshot:      33   500000/Snap    0.300M/sec   29.994 Gbps   10.581 Mpps | Read:0.014 Process:0.067 Merge:0.018 Output:0.352 JSONDump:0.150 MACTop:0.000 GeoIP:0.048 Send:0.060 ] Push[ESSock:   0 ESCnt:19952 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    637.997 Kdps    0.691 Gbps]
[20211013_133814] ltrace              :  144 | [Wed Oct 13 13:38:14 2021]:   1.25 usec/msg  798896 Msg/sec Ingress[Inflight: 6890 Read:0.000 Fwd:0.000] Flow[Snapshot:      41   500000/Snap    0.799M/sec   79.890 Gbps   28.183 Mpps | Read:0.013 Process:0.065 Merge:0.016 Output:0.361 JSONDump:0.154 MACTop:0.000 GeoIP:0.050 Send:0.061 ] Push[ESSock:   0 ESCnt:22922 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    564.774 Kdps    0.612 Gbps]

Flows 500K @ 50Gbps Profile: 128B Fixed

GEOIP Enable

Output: ESNULL

Results

  • 39.99Gbps

  • 39.0Mpps

Flow Generation

./pcap_genflow --pktcnt 1e9 --flowcnt 500e3 --pktsize 128 --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json500K_50G_128B

pcap2json

[20211013_132433] ltrace              :  144 | [Wed Oct 13 13:24:33 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.096 Process:0.156 Merge:0.162 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_132438] ltrace              :  144 | [Wed Oct 13 13:24:38 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.093 Process:0.183 Merge:0.155 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  751 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    143.202 Kdps    0.155 Gbps]
[20211013_132443] ltrace              :  144 | [Wed Oct 13 13:24:43 2021]:   2.50 usec/msg  399900 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       4   500000/Snap    0.400M/sec   35.814 Gbps   34.974 Mpps | Read:0.062 Process:0.144 Merge:0.107 Output:0.142 JSONDump:0.063 MACTop:0.000 GeoIP:0.023 Send:0.018 ] Push[ESSock:   0 ESCnt: 2910 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    411.222 Kdps    0.446 Gbps]
[20211013_132448] ltrace              :  144 | [Wed Oct 13 13:24:48 2021]:   2.50 usec/msg  399927 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       8   500000/Snap    0.400M/sec   39.993 Gbps   39.055 Mpps | Read:0.049 Process:0.122 Merge:0.083 Output:0.058 JSONDump:0.025 MACTop:0.000 GeoIP:0.009 Send:0.008 ] Push[ESSock:   0 ESCnt: 5099 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    416.885 Kdps    0.452 Gbps]
[20211013_132453] ltrace              :  144 | [Wed Oct 13 13:24:53 2021]:   2.50 usec/msg  399915 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:      12   500000/Snap    0.400M/sec   39.992 Gbps   39.054 Mpps | Read:0.041 Process:0.106 Merge:0.069 Output:0.044 JSONDump:0.019 MACTop:0.000 GeoIP:0.007 Send:0.006 ] Push[ESSock:   0 ESCnt: 7211 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    402.209 Kdps    0.436 Gbps]

Flows 500K @ 50Gbps Profile: 64B Fixed

GEOIP Enable

Output: ESNULL

Results

  • 19.99Gbps

  • 39.05Mpps

Flow Generation

 ./pcap_genflow --pktcnt 1e9 --flowcnt 500e3 --pktsize 64 --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json500K_50G_64B

pcap2json

[20211013_132224] ltrace              :  144 | [Wed Oct 13 13:22:24 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.096 Process:0.155 Merge:0.165 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_132229] ltrace              :  144 | [Wed Oct 13 13:22:29 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec    0.000 Gbps    0.000 Mpps | Read:0.095 Process:0.156 Merge:0.162 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  232 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB     44.272 Kdps    0.048 Gbps]
[20211013_132234] ltrace              :  144 | [Wed Oct 13 13:22:34 2021]:   5.00 usec/msg  199856 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       2   500000/Snap    0.200M/sec   11.167 Gbps   21.810 Mpps | Read:0.085 Process:0.139 Merge:0.139 Output:0.061 JSONDump:0.029 MACTop:0.000 GeoIP:0.009 Send:0.006 ] Push[ESSock:   0 ESCnt: 1313 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    205.896 Kdps    0.223 Gbps]
[20211013_132239] ltrace              :  144 | [Wed Oct 13 13:22:39 2021]:   5.00 usec/msg  199955 Msg/sec Ingress[Inflight:   12 Read:0.000 Fwd:0.000] Flow[Snapshot:       4   500000/Snap    0.200M/sec   19.996 Gbps   39.054 Mpps | Read:0.075 Process:0.124 Merge:0.122 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 2409 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    208.724 Kdps    0.226 Gbps]
[20211013_132244] ltrace              :  144 | [Wed Oct 13 13:22:44 2021]:   5.00 usec/msg  199945 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       6   500000/Snap    0.200M/sec   19.994 Gbps   39.052 Mpps | Read:0.068 Process:0.115 Merge:0.111 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt: 3558 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    218.811 Kdps    0.237 Gbps]

Flows 100K @ 50Gbps Profile: 64B Fixed

GEOIP Enable

Output ESNULL

Results

  • 19.98Gbps

  • 39.056Mpps

Flow Generation

./pcap_genflow --pktcnt 1e9 --flowcnt 100e3 --pktsize 64 --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json100K_50G_64B

pcap2json

[20211013_132006] ltrace              :  144 | [Wed Oct 13 13:20:06 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       0        0/Snap    0.000M/sec      nan Gbps      nan Mpps | Read:0.097 Process:0.139 Merge:0.165 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:    0 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_132011] ltrace              :  144 | [Wed Oct 13 13:20:11 2021]:  25.00 usec/msg   39993 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       2   100000/Snap    0.040M/sec   16.849 Gbps   32.908 Mpps | Read:0.090 Process:0.131 Merge:0.154 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  210 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB     39.994 Kdps    0.043 Gbps]
[20211013_132016] ltrace              :  144 | [Wed Oct 13 13:20:16 2021]:  25.02 usec/msg   39966 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:       4   100000/Snap    0.040M/sec   19.983 Gbps   39.030 Mpps | Read:0.083 Process:0.123 Merge:0.144 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  420 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB     39.967 Kdps    0.043 Gbps]
[20211013_132021] ltrace              :  144 | [Wed Oct 13 13:20:21 2021]:  25.00 usec/msg   39992 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:       6   100000/Snap    0.040M/sec   19.997 Gbps   39.056 Mpps | Read:0.077 Process:0.116 Merge:0.135 Output:0.000 JSONDump:0.000 MACTop:0.000 GeoIP:0.000 Send:0.000 ] Push[ESSock:   0 ESCnt:  663 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB     46.280 Kdps    0.050 Gbps]

Flows 100K @ 50Gbps Profile: IMIX

GEOIP Enabled

Output ESNULL

Results

  • 109.98Gbps

  • 38.799Mpps

Flow Generation

./pcap_genflow --pktcnt 1e9 --flowcnt 100e3 --imix --pktslice 128 --bps 50e9 | sudo stream_upload --name pcap2json100K_50G_imix

pcap2json

[20211013_131309] ltrace              :  144 | [Wed Oct 13 13:13:09 2021]:   0.00 usec/msg       0 Msg/sec Ingress[Inflight:   13 Read:0.000 Fwd:0.000] Flow[Snapshot:       2   100000/Snap    0.000M/sec      inf Gbps      inf Mpps | Read:0.082 Process:0.140 Merge:0.152 Output:0.085 JSONDump:0.042 MACTop:0.000 GeoIP:0.016 Send:0.010 ] Push[ESSock:   0 ESCnt:  278 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB      0.000 Kdps    0.000 Gbps]
[20211013_131314] ltrace              :  144 | [Wed Oct 13 13:13:14 2021]:   4.55 usec/msg  219896 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      13   100000/Snap    0.220M/sec  109.949 Gbps   38.787 Mpps | Read:0.057 Process:0.105 Merge:0.103 Output:0.050 JSONDump:0.028 MACTop:0.000 GeoIP:0.009 Send:0.006 ] Push[ESSock:   0 ESCnt: 1528 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    237.989 Kdps    0.258 Gbps]
[20211013_131319] ltrace              :  144 | [Wed Oct 13 13:13:19 2021]:   4.17 usec/msg  239927 Msg/sec Ingress[Inflight:   16 Read:0.000 Fwd:0.000] Flow[Snapshot:      25   100000/Snap    0.240M/sec  119.962 Gbps   42.320 Mpps | Read:0.048 Process:0.091 Merge:0.086 Output:0.042 JSONDump:0.023 MACTop:0.000 GeoIP:0.008 Send:0.005 ] Push[ESSock:   0 ESCnt: 2748 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    232.309 Kdps    0.252 Gbps]
[20211013_131324] ltrace              :  144 | [Wed Oct 13 13:13:24 2021]:   4.17 usec/msg  239956 Msg/sec Ingress[Inflight:   15 Read:0.000 Fwd:0.000] Flow[Snapshot:      37   100000/Snap    0.240M/sec  119.979 Gbps   42.325 Mpps | Read:0.044 Process:0.086 Merge:0.079 Output:0.046 JSONDump:0.025 MACTop:0.000 GeoIP:0.008 Send:0.006 ] Push[ESSock:   0 ESCnt: 3966 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    231.955 Kdps    0.251 Gbps]
[20211013_131329] ltrace              :  144 | [Wed Oct 13 13:13:29 2021]:   4.55 usec/msg  219963 Msg/sec Ingress[Inflight:   14 Read:0.000 Fwd:0.000] Flow[Snapshot:      48   100000/Snap    0.220M/sec  109.982 Gbps   38.799 Mpps | Read:0.042 Process:0.082 Merge:0.075 Output:0.092 JSONDump:0.050 MACTop:0.000 GeoIP:0.016 Send:0.011 ] Push[ESSock:   0 ESCnt: 5172 ESErr:0 ESTimeout:    0 ESPending:     0.0 MB    229.681 Kdps    0.249 Gbps]
PreviousLogfiles

Last updated