[Feature Request]: Replace snappy with other crc32c packages for tfrecordio

[liferoad]

What would you like to happen?

The latest snappy (>=0.7) does not use crc32c directly now. We should explore other crc32c packages to replace snappy. Some candidates: https://pypi.org/project/crc32c/ and https://pypi.org/project/google-crc32c/.

See #33407 with more details

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Brijeshthummar02]

@liferoad can you explain more about issue, also provide me path to file. i will have a look.

[liferoad]

We use this to compute a masked crc32c checksum for a value:

beam/sdks/python/apache_beam/io/tfrecordio.py

Line 51 in 286e29c

if getattr(snappy, '_crc32c', None):

I do not think we need snappy any more since we could directly use some crc32c packages.

cc @tvalentyn

[tvalentyn]

Yes, I also saw that fastavro implementation is moving away from snappy.