FazBrowse GitHub Viewer
|
Trending
|
URL:
|
Home
Tools:
[Download Repo ZIP]
[View Raw Code]
[Original HTTPS Page]
docker-python/tests/test_pytext.py at master · eggachecat/docker-python · GitHub
eggachecat
/
docker-python
Public
forked from
Kaggle/docker-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Expand file tree
Breadcrumbs
docker-python
/
tests
/
test_pytext.py
Copy path
More file actions
More file actions
Latest commit
History
History
History
14 lines (10 loc) · 468 Bytes
Breadcrumbs
docker-python
/
tests
/
test_pytext.py
Copy path
File metadata and controls
14 lines (10 loc) · 468 Bytes
Raw
Copy raw file
Download raw file
Open symbols panel
Edit and raw actions
1
2
3
4
5
6
7
8
9
10
11
12
13
14
import
unittest
from
pytext
.
config
.
field_config
import
FeatureConfig
from
pytext
.
data
.
featurizer
import
InputRecord
,
SimpleFeaturizer
class
TestPyText
(
unittest
.
TestCase
):
def
test_tokenize
(
self
):
featurizer
=
SimpleFeaturizer
.
from_config
(
SimpleFeaturizer
.
Config
(),
FeatureConfig
()
)
tokens
=
featurizer
.
featurize
(
InputRecord
(
raw_text
=
"At eight o'clock"
)).
tokens
self
.
assertEqual
([
'at'
,
'eight'
,
"o'clock"
],
tokens
)
Back
|
FazBrowse Home
|
New Git URL