Skip to content

Commit 3f3b595

Browse files
committed
Merge remote-tracking branch 'parent/master' into sync-fork
# Conflicts: # Makefile # Pipfile # Pipfile.lock # README.rst # dockerfiles/buildwheel.sh # dockerfiles/develop/Dockerfile # dockerfiles/slim/Dockerfile # pyproject.toml # requirements-dev.txt # setup.py # src/cchardet/version.py # src/tests/bench.py # tox.ini
2 parents 3af7068 + fa74a8e commit 3f3b595

File tree

161 files changed

+913
-2011
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

161 files changed

+913
-2011
lines changed

.github/workflows/build.yaml

+59
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
name: Build Wheels
2+
on:
3+
push:
4+
branches: [master]
5+
create:
6+
workflow_dispatch:
7+
8+
jobs:
9+
build_wheels:
10+
strategy:
11+
matrix:
12+
os: ["ubuntu-latest", "windows-latest", "macos-latest"]
13+
runs-on: ${{ matrix.os }}
14+
name: Build wheels on ${{ matrix.os }}
15+
16+
steps:
17+
- name: Set up QEMU
18+
if: runner.os == 'Linux'
19+
uses: docker/setup-qemu-action@v3
20+
with:
21+
platforms: all
22+
23+
- uses: actions/checkout@v4
24+
with:
25+
submodules: "recursive"
26+
27+
- uses: actions/setup-python@v5
28+
with:
29+
python-version: "3.x"
30+
cache: "pip"
31+
32+
- name: Install dependencies
33+
shell: bash
34+
run: |
35+
python -VV
36+
pip install -r requirements-dev.txt
37+
38+
- name: Cythonize
39+
shell: bash
40+
run: |
41+
python -VV
42+
make cython
43+
44+
- name: Build
45+
uses: pypa/cibuildwheel@v2.18.1
46+
env:
47+
# NOTICE: ローカルでは想定通りにテストは通るが、 cibuildwheel では 特定のファイルの文字コード検知がうまくいかないので一時的に無効化する
48+
# CIBW_TEST_REQUIRES: "pytest"
49+
# CIBW_TEST_COMMAND: "pytest {project}/tests"
50+
51+
CIBW_ARCHS_LINUX: auto aarch64
52+
CIBW_ARCHS_MACOS: x86_64 universal2 arm64
53+
CIBW_SKIP: pp* cp36-* cp37-* cp38-*
54+
55+
- name: Upload Wheels to artifact
56+
uses: actions/upload-artifact@v4
57+
with:
58+
name: wheels-${{ matrix.os }}
59+
path: wheelhouse

.github/workflows/test.yml

+53
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,53 @@
1+
name: Run tests
2+
on:
3+
push:
4+
pull_request:
5+
create:
6+
7+
jobs:
8+
test:
9+
strategy:
10+
matrix:
11+
os: ["ubuntu-latest", "windows-latest", "macos-latest"]
12+
py: ["3.13-dev", "3.12", "3.11", "3.10", "3.9"]
13+
14+
runs-on: ${{ matrix.os }}
15+
name: Run test with Python ${{ matrix.py }} on ${{ matrix.os }}
16+
17+
steps:
18+
- name: Checkout
19+
uses: actions/checkout@v4
20+
with:
21+
submodules: "recursive"
22+
23+
- name: Set up Python
24+
uses: actions/setup-python@v5
25+
with:
26+
python-version: ${{ matrix.py }}
27+
allow-prereleases: true
28+
cache: "pip"
29+
30+
- name: Install dependencies
31+
shell: bash
32+
run: |
33+
python -VV
34+
pip install -r requirements-dev.txt
35+
36+
- name: Build
37+
shell: bash
38+
run: |
39+
python -VV
40+
make cython
41+
pip install .
42+
43+
- name: Lint
44+
shell: bash
45+
run: |
46+
python -VV
47+
ruff check
48+
49+
- name: Test
50+
shell: bash
51+
run: |
52+
python -VV
53+
pytest -vs tests

.gitignore

+7
Original file line numberDiff line numberDiff line change
@@ -46,3 +46,10 @@ None
4646

4747
.DS_Store
4848
/.vscode/
49+
.pytest_cache
50+
.ruff_cache
51+
__pycache__
52+
.venv
53+
wheelhouse
54+
archives
55+
*.whl

CHANGES.md

+101
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,101 @@
1+
# CHANGES
2+
3+
## 2.x.x
4+
5+
## 2.2.0-alpha.2 (2024-06-xx)
6+
7+
- Improve test codes and CI/CD workflows
8+
9+
## 2.2.0-alpha.1 (2024-06-07)
10+
11+
- support Python 3.10, 3.11, 3.12
12+
- drop support for Python 3.6, 3.7, 3.8
13+
- experimental support for arm64
14+
- improve some CI/CD workflows
15+
- migration from nose to pytest (#87)
16+
17+
## 2.1.7 (2020-10-27)
18+
19+
- support Python 3.9
20+
- drop support for Python 3.5
21+
22+
## 2.1.6 (2020-03-17)
23+
24+
- drop support for Python 2.7
25+
- support Github Actions
26+
- update dev-dependencies
27+
28+
## 2.1.5 (2019-09-27)
29+
30+
- update language models (uchardet)
31+
- add iso8859-2 test but disabled it
32+
- support Python 3.8
33+
- drop support for Python 3.4
34+
35+
## 2.1.4 (2018-09-27)
36+
37+
- disable LTO because become poor performance
38+
39+
## 2.1.3 (2018-09-26)
40+
41+
- support Python 3.7
42+
43+
## 2.1.2 (2018-09-26)
44+
45+
- enable [LTO](https://gcc.gnu.org/wiki/LinkTimeOptimization) for wheel builds
46+
- update Cython
47+
48+
## 2.1.1 (2017-07-01)
49+
50+
- fix that different results with different chuck sizes
51+
- fix that assignments to nsSMState in nsCodingStateMachine result in unspecified behavior
52+
- include COPYING in package
53+
54+
## 2.1.0 (2017-05-15)
55+
56+
- add cchardetect CLI script ([#30](https://github.com/PyYoshi/cChardet/pull/30))[\@craigds](https://github.com/craigds)
57+
58+
## 2.0.1 (2017-04-25)
59+
60+
- fix an issue where UTF-8 with a BOM would not be detected as UTF-8-SIG (fix [#28](https://github.com/PyYoshi/cChardet/issues/28))
61+
- pass NULL Byte to feed() / detect() (fix [#27](https://github.com/PyYoshi/cChardet/issues/27))
62+
63+
## 2.0.0 (2017-04-06)
64+
65+
- Improve tests
66+
67+
## 2.0a4 (2017-04-05)
68+
69+
- Update uchardet repo (Fix buffer overflow)
70+
71+
## 2.0a3 (2017-03-29)
72+
73+
- Implement UniversalDetector (like chardet)
74+
75+
## 2.0a2 (2017-03-28)
76+
77+
- Update uchardet repo (Fix memory leak)
78+
79+
## 2.0a1 (2017-03-28)
80+
81+
- Replace [uchardet-enhanced](https://bitbucket.org/medoc/uchardet-enhanced/overview) to [uchardet](https://github.com/PyYoshi/uchardet)
82+
- Remove Detector class
83+
84+
## 1.1.3 (2017-02-26)
85+
86+
- Support AArch64
87+
88+
## 1.1.2 (2017-01-08)
89+
90+
- Support Python 3.6
91+
92+
## 1.1.1 (2016-11-05)
93+
94+
- Use len() function (9e61cb9e96b138b0d18e5f9e013e144202ae4067)
95+
- Remove detect function in \_cchardet.pyx (25b581294fc0ae8f686ac9972c8549666766f695)
96+
- Support manylinux1 wheel
97+
98+
## 1.1.0 (2016-10-17)
99+
100+
- Add Detector class
101+
- Improve unit tests

CHANGES.rst

-125
This file was deleted.

MANIFEST.in

+1-1
Original file line numberDiff line numberDiff line change
@@ -2,4 +2,4 @@ include *.txt
22
include CHANGES.rst COPYING README.rst
33
recursive-include src *.pyx *.pxd *.pxi *.py *.cpp
44
recursive-include src/ext *
5-
recursive-include src/tests *
5+
recursive-include tests *

0 commit comments

Comments
 (0)