Adding subset of text preprocessing Keras APis and unit tests. · Nuttiwut-psw/TensorFlow.NET@e1b1faf · GitHub

Nuttiwut-psw / TensorFlow.NET Public

forked from SciSharp/TensorFlow.NET

• Notifications You must be signed in to change notification settings
• Fork 0
• Star 0

• Code
• Pull requests
• Actions
• Projects
• Security and quality
• Insights

Additional navigation options

Commit e1b1faf

Browse filesBrowse the repository at this point in the historyBrowse files

Niklas Gustafsson

authored and

Esther2013

committed

Adding subset of text preprocessing Keras APis and unit tests.

1 parent 8909761 commit e1b1faf
Copy full SHA for e1b1faf

5 files changed

+917-8Lines changed: 917 additions & 8 deletions

File tree

Expand file treeCollapse file tree

Open diff view settings

Filter options

• src/TensorFlowNET.Keras
  • Preprocessings
    • Preprocessing.cs
    • Tokenizer.cs
  • Sequence.cs
  • TextApi.cs
• test/TensorFlowNET.Keras.UnitTest
  • PreprocessingTests.cs

Expand file treeCollapse file tree

Open diff view settings

Collapse file

‎src/TensorFlowNET.Keras/Preprocessings/Preprocessing.cs‎

Copy file name to clipboardExpand all lines: src/TensorFlowNET.Keras/Preprocessings/Preprocessing.cs

+4Lines changed: 4 additions & 0 deletions

Original file line number	Diff line number	Diff line change
@@ -10,6 +10,10 @@ public partial class Preprocessing
10	10	public Sequence sequence => new Sequence();
11	11	public DatasetUtils dataset_utils => new DatasetUtils();
12	12
	13	+ public TextApi text => _text;
	14	+
	15	+ private static TextApi _text = new TextApi();
	16	+
13	17	public TextVectorization TextVectorization(Func<Tensor, Tensor> standardize = null,
14	18	string split = "whitespace",
15	19	int max_tokens = -1,

0 commit comments

Comments

0 (0)