Add ability to redirect CHIP logs to a callback and add python log callback integration

[andy31415]

Problem

Python scripting cannot easily capture logs (and generally log redirects do not seem possible)

Summary of Changes

Add the ability to redirect CHIP Logging to a callback, implement such a log redirect in python.

[github-actions]

Size increase report for "esp32-example-build" from 5ca7308

File	Section	File	VM
chip-all-clusters-app.elf	.flash.text	20	20
chip-all-clusters-app.elf	.dram0.bss	0	8
chip-pigweed-app.elf	.flash.text	20	20
chip-pigweed-app.elf	.dram0.bss	0	8

Full report output

BLOAT REPORT

Files found only in the build output:
    report.csv

Comparing ./master_artifact/chip-all-clusters-app.elf and ./pull_artifact/chip-all-clusters-app.elf:

sections,vmsize,filesize
.debug_info,0,151
.debug_str,0,134
.debug_line,0,104
.debug_abbrev,0,62
.strtab,0,54
.debug_frame,0,24
.flash.text,20,20
.symtab,0,16
.debug_aranges,0,8
.debug_ranges,0,8
.dram0.bss,8,0
.shstrtab,0,2
.xt.prop._ZTVN4chip11DeviceLayer37DeviceNetworkProvisioningDelegateImplE,0,2
.debug_loc,0,-1

Comparing ./master_artifact/chip-pigweed-app.elf and ./pull_artifact/chip-pigweed-app.elf:

sections,vmsize,filesize
.debug_info,0,151
.debug_str,0,134
.debug_line,0,104
.debug_abbrev,0,62
.strtab,0,54
.debug_frame,0,24
.flash.text,20,20
.symtab,0,16
.debug_aranges,0,8
.debug_ranges,0,8
.dram0.bss,8,0
.shstrtab,0,2
.debug_loc,0,-1
.xt.prop._ZSt9__find_ifIPKSt4byteN9__gnu_cxx5__ops10_Iter_predIPFbS0_EEEET_S9_S9_T0_St26random_access_iterator_tag,0,-2

[msandstedt]

Can this be rebased on master? The history is pretty hard to look at with all of the commits from #4960.

[andy31415]

Can this be rebased on master? The history is pretty hard to look at with all of the commits from #4960.

The best I could do would be to squash all commits. Master does squash merges today so I cannot properly rebase it (or at least I tried and failed).

[msandstedt]

Can this be rebased on master? The history is pretty hard to look at with all of the commits from #4960.

The best I could do would be to squash all commits. Master does squash merges today so I cannot properly rebase it (or at least I tried and failed).

I meant rebase and squash locally, and then force-push. This is fine though as long as whomever merges uses the squash option.

[github-actions]

Size increase report for "gn_qpg6100-example-build" from 8a6335b

File	Section	File	VM
chip-qpg6100-lock-example.out	.text	16	16
chip-qpg6100-lock-example.out	.bss	0	8
chip-qpg6100-lock-example.out	.heap	0	-8

Full report output

BLOAT REPORT

Files found only in the build output:
    report.csv

Comparing ./master_artifact/chip-qpg6100-lock-example.out and ./pull_artifact/chip-qpg6100-lock-example.out:

sections,vmsize,filesize
.debug_info,0,174
.debug_str,0,129
.debug_abbrev,0,60
.strtab,0,54
.debug_line,0,51
.symtab,0,48
.debug_loc,0,42
.debug_frame,0,16
.text,16,16
.bss,8,0
.debug_aranges,0,8
.debug_ranges,0,8
.shstrtab,0,2
.heap,-8,0
[Unmapped],0,-16

[github-actions]

Size increase report for "nrfconnect-example-build" from 8a6335b

File	Section	File	VM
chip-shell.elf	text	16	16
chip-lighting.elf	text	16	16
chip-lock.elf	[LOAD #3 [RW]]	0	31
chip-lock.elf	text	16	16
chip-lock.elf	bss	0	1

Full report output

BLOAT REPORT

Files found only in the build output:
    report.csv

Comparing ./master_artifact/chip-shell.elf and ./pull_artifact/chip-shell.elf:

sections,vmsize,filesize
.debug_info,0,154
.debug_str,0,131
.debug_abbrev,0,65
.debug_line,0,61
.strtab,0,54
.symtab,0,48
.debug_frame,0,20
text,16,16
.debug_loc,0,9
.debug_aranges,0,8
.debug_ranges,0,8
.shstrtab,0,2

Comparing ./master_artifact/chip-lighting.elf and ./pull_artifact/chip-lighting.elf:

sections,vmsize,filesize
.debug_info,0,154
.debug_str,0,131
.debug_abbrev,0,65
.debug_line,0,61
.strtab,0,54
.symtab,0,48
.debug_loc,0,33
.debug_frame,0,20
text,16,16
.debug_aranges,0,8
.debug_ranges,0,8
.shstrtab,0,2

Comparing ./master_artifact/chip-lock.elf and ./pull_artifact/chip-lock.elf:

sections,vmsize,filesize
.debug_info,0,154
.debug_str,0,131
.debug_abbrev,0,65
.debug_line,0,61
.strtab,0,54
.symtab,0,48
[LOAD #3 [RW]],31,0
.debug_loc,0,25
.debug_frame,0,20
text,16,16
.debug_aranges,0,8
.debug_ranges,0,8
bss,1,0
.shstrtab,0,-2

[mspang]

1. There is missing synchronization between replacing and accessing callbacks.
2. How does this work with the Python GIL ?

[CLAassistant]

All committers have signed the CLA.

[andy31415]

1. There is missing synchronization between replacing and accessing callbacks.
2. How does this work with the Python GIL ?

Python sets the callbacks at startup, before the CHIP threads are initialized or have a chance to log anything.

Did not have trouble here with GIL while running iPython - logs do show up while in the editor.

[andy31415]

Added synchronization via std::atomic

Comments were addressed