[ Web Proxy ]
URL:
Viewing:
https://github-redirect.dependabot.com/python/cpython/blob/main/Modules/expat/xmltok.h
[Back]
[Original]
cpython/Modules/expat/xmltok.h at main python/cpython GitHub
Skip to content
Navigation Menu
Sign in
Products
Platform
[]
[]
GitHub
Repository hosting, code review, and collaboration
[]
[]
Copilot
AI coding agent for tasks, projects and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Events
Changelog
[]
[]
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
[]
[]
GitHub Universe
The event for developers, by developers talks, workshops, and whats next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
python
cpython
Repository navigation
Code
Issues
5k+
(5k+)
Pull requests
2.3k
(2.3k)
Actions
Projects
Security and quality
Insights
More
items
Files
Expand file tree
main
Breadcrumbs
cpython
/
Modules
/
expat
/
xmltok.h
Copy path
Blame
More file actions
Blame
More file actions
Latest commit
History
History
History
317 lines (257 loc) 12.6 KB
main
Breadcrumbs
cpython
/
Modules
/
expat
/
xmltok.h
Copy path
Top
File metadata and controls
Code
Blame
317 lines (257 loc) 12.6 KB
Raw
Copy raw file
Download raw file
Open symbols panel
Edit and raw actions
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
/*
__ __ _
___\ \/ /_ __ __ _| |_
/ _ \\ /| '_ \ / _` | __|
| __// \| |_) | (_| | |_
\___/_/\_\ .__/ \__,_|\__|
|_| XML parser
Copyright (c) 1997-2000 Thai Open Source Software Center Ltd
Copyright (c) 2000 Clark Cooper <coopercc@users.sourceforge.net>
Copyright (c) 2002 Fred L. Drake, Jr. <fdrake@users.sourceforge.net>
Copyright (c) 2002-2005 Karl Waclawek <karl@waclawek.net>
Copyright (c) 2016-2026 Sebastian Pipping <sebastian@pipping.org>
Copyright (c) 2017 Rhodri James <rhodri@wildebeest.org.uk>
Licensed under the MIT license:
Permission is hereby granted, free of charge, to any person obtaining
a copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to permit
persons to whom the Software is furnished to do so, subject to the
following conditions:
The above copyright notice and this permission notice shall be included
in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN
NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM,
DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE
USE OR OTHER DEALINGS IN THE SOFTWARE.
SPDX-License-Identifier: MIT
*/
#ifndef
XmlTok_INCLUDED
# define
XmlTok_INCLUDED
1
# include
<stdint.h>
// uint64_t
/* The following token may be returned by XmlContentTok */
# define
XML_TOK_TRAILING_RSQB
\
-5
/* ] or ]] at the end of the scan; might be \
start of illegal ]]> sequence */
/* The following tokens may be returned by both XmlPrologTok and
XmlContentTok.
*/
# define
XML_TOK_NONE
-4
/* The string to be scanned is empty */
# define
XML_TOK_TRAILING_CR
\
-3
/* A CR at the end of the scan; \
might be part of CRLF sequence */
# define
XML_TOK_PARTIAL_CHAR
-2
/* only part of a multibyte sequence */
# define
XML_TOK_PARTIAL
-1
/* only part of a token */
# define
XML_TOK_INVALID
0
/* The following tokens are returned by XmlContentTok; some are also
returned by XmlAttributeValueTok, XmlEntityTok, XmlCdataSectionTok.
*/
# define
XML_TOK_START_TAG_WITH_ATTS
1
# define
XML_TOK_START_TAG_NO_ATTS
2
# define
XML_TOK_EMPTY_ELEMENT_WITH_ATTS
3
/* empty element tag <e/> */
# define
XML_TOK_EMPTY_ELEMENT_NO_ATTS
4
# define
XML_TOK_END_TAG
5
# define
XML_TOK_DATA_CHARS
6
# define
XML_TOK_DATA_NEWLINE
7
# define
XML_TOK_CDATA_SECT_OPEN
8
# define
XML_TOK_ENTITY_REF
9
# define
XML_TOK_CHAR_REF
10
/* numeric character reference */
/* The following tokens may be returned by both XmlPrologTok and
XmlContentTok.
*/
# define
XML_TOK_PI
11
/* processing instruction */
# define
XML_TOK_XML_DECL
12
/* XML decl or text decl */
# define
XML_TOK_COMMENT
13
# define
XML_TOK_BOM
14
/* Byte order mark */
/* The following tokens are returned only by XmlPrologTok */
# define
XML_TOK_PROLOG_S
15
# define
XML_TOK_DECL_OPEN
16
/* <!foo */
# define
XML_TOK_DECL_CLOSE
17
/* > */
# define
XML_TOK_NAME
18
# define
XML_TOK_NMTOKEN
19
# define
XML_TOK_POUND_NAME
20
/* #name */
# define
XML_TOK_OR
21
/* | */
# define
XML_TOK_PERCENT
22
# define
XML_TOK_OPEN_PAREN
23
# define
XML_TOK_CLOSE_PAREN
24
# define
XML_TOK_OPEN_BRACKET
25
# define
XML_TOK_CLOSE_BRACKET
26
# define
XML_TOK_LITERAL
27
# define
XML_TOK_PARAM_ENTITY_REF
28
# define
XML_TOK_INSTANCE_START
29
/* The following occur only in element type declarations */
# define
XML_TOK_NAME_QUESTION
30
/* name? */
# define
XML_TOK_NAME_ASTERISK
31
/* name* */
# define
XML_TOK_NAME_PLUS
32
/* name+ */
# define
XML_TOK_COND_SECT_OPEN
33
/* <![ */
# define
XML_TOK_COND_SECT_CLOSE
34
/* ]]> */
# define
XML_TOK_CLOSE_PAREN_QUESTION
35
/* )? */
# define
XML_TOK_CLOSE_PAREN_ASTERISK
36
/* )* */
# define
XML_TOK_CLOSE_PAREN_PLUS
37
/* )+ */
# define
XML_TOK_COMMA
38
/* The following token is returned only by XmlAttributeValueTok */
# define
XML_TOK_ATTRIBUTE_VALUE_S
39
/* The following token is returned only by XmlCdataSectionTok */
# define
XML_TOK_CDATA_SECT_CLOSE
40
/* With namespace processing this is returned by XmlPrologTok for a
name with a colon.
*/
# define
XML_TOK_PREFIXED_NAME
41
# ifdef
XML_DTD
# define
XML_TOK_IGNORE_SECT
42
# endif
/* XML_DTD */
# ifdef
XML_DTD
# define
XML_N_STATES
4
# else
/* not XML_DTD */
# define
XML_N_STATES
3
# endif
/* not XML_DTD */
# define
XML_PROLOG_STATE
0
# define
XML_CONTENT_STATE
1
# define
XML_CDATA_SECTION_STATE
2
# ifdef
XML_DTD
# define
XML_IGNORE_SECTION_STATE
3
# endif
/* XML_DTD */
# define
XML_N_LITERAL_TYPES
2
# define
XML_ATTRIBUTE_VALUE_LITERAL
0
# define
XML_ENTITY_VALUE_LITERAL
1
/* The size of the buffer passed to XmlUtf8Encode must be at least this. */
# define
XML_UTF8_ENCODE_MAX
4
/* The size of the buffer passed to XmlUtf16Encode must be at least this. */
# define
XML_UTF16_ENCODE_MAX
2
typedef
struct
position
{
/* first line and first column are 0 not 1 */
uint64_t
lineNumber
;
uint64_t
columnNumber
;
}
POSITION
;
typedef
struct
{
const
char
*
name
;
const
char
*
valuePtr
;
const
char
*
valueEnd
;
char
normalized
;
}
ATTRIBUTE
;
struct
encoding
;
typedef
struct
encoding
ENCODING
;
typedef
int
(
*
SCANNER
)(
const
ENCODING
*
,
const
char
*
,
const
char
*
,
const
char
*
*
);
enum
XML_Convert_Result
{
XML_CONVERT_COMPLETED
=
0
,
XML_CONVERT_INPUT_INCOMPLETE
=
1
,
XML_CONVERT_OUTPUT_EXHAUSTED
=
2
/* and therefore potentially input remaining
as well */
};
struct
encoding
{
SCANNER
scanners
[
XML_N_STATES
];
SCANNER
literalScanners
[
XML_N_LITERAL_TYPES
];
int
(
*
nameMatchesAscii
)(
const
ENCODING
*
,
const
char
*
,
const
char
*
,
const
char
*
);
int
(
*
nameLength
)(
const
ENCODING
*
,
const
char
*
);
const
char
*
(
*
skipS
)(
const
ENCODING
*
,
const
char
*
);
int
(
*
getAtts
)(
const
ENCODING
*
enc
,
const
char
*
ptr
,
int
attsMax
,
ATTRIBUTE
*
atts
);
int
(
*
charRefNumber
)(
const
ENCODING
*
enc
,
const
char
*
ptr
);
int
(
*
predefinedEntityName
)(
const
ENCODING
*
,
const
char
*
,
const
char
*
);
void
(
*
updatePosition
)(
const
ENCODING
*
,
const
char
*
ptr
,
const
char
*
end
,
POSITION
*
);
int
(
*
isPublicId
)(
const
ENCODING
*
enc
,
const
char
*
ptr
,
const
char
*
end
,
const
char
*
*
badPtr
);
enum
XML_Convert_Result
(
*
utf8Convert
)(
const
ENCODING
*
enc
,
const
char
*
*
fromP
,
const
char
*
fromLim
,
char
*
*
toP
,
const
char
*
toLim
);
enum
XML_Convert_Result
(
*
utf16Convert
)(
const
ENCODING
*
enc
,
const
char
*
*
fromP
,
const
char
*
fromLim
,
unsigned short
*
*
toP
,
const
unsigned short
*
toLim
);
int
minBytesPerChar
;
char
isUtf8
;
char
isUtf16
;
};
/* Scan the string starting at ptr until the end of the next complete
token, but do not scan past eptr. Return an integer giving the
type of token.
Return XML_TOK_NONE when ptr == eptr; nextTokPtr will not be set.
Return XML_TOK_PARTIAL when the string does not contain a complete
token; nextTokPtr will not be set.
Return XML_TOK_INVALID when the string does not start a valid
token; nextTokPtr will be set to point to the character which made
the token invalid.
Otherwise the string starts with a valid token; nextTokPtr will be
set to point to the character following the end of that token.
Each data character counts as a single token, but adjacent data
characters may be returned together. Similarly for characters in
the prolog outside literals, comments and processing instructions.
*/
# define
XmlTok
(
enc
,
state
,
ptr
,
end
,
nextTokPtr
) \
(((enc)->scanners[state])(enc, ptr, end, nextTokPtr))
# define
XmlPrologTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlTok(enc, XML_PROLOG_STATE, ptr, end, nextTokPtr)
# define
XmlContentTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlTok(enc, XML_CONTENT_STATE, ptr, end, nextTokPtr)
# define
XmlCdataSectionTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlTok(enc, XML_CDATA_SECTION_STATE, ptr, end, nextTokPtr)
# ifdef
XML_DTD
# define
XmlIgnoreSectionTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlTok(enc, XML_IGNORE_SECTION_STATE, ptr, end, nextTokPtr)
# endif
/* XML_DTD */
/* This is used for performing a 2nd-level tokenization on the content
of a literal that has already been returned by XmlTok.
*/
# define
XmlLiteralTok
(
enc
,
literalType
,
ptr
,
end
,
nextTokPtr
) \
(((enc)->literalScanners[literalType])(enc, ptr, end, nextTokPtr))
# define
XmlAttributeValueTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlLiteralTok(enc, XML_ATTRIBUTE_VALUE_LITERAL, ptr, end, nextTokPtr)
# define
XmlEntityValueTok
(
enc
,
ptr
,
end
,
nextTokPtr
) \
XmlLiteralTok(enc, XML_ENTITY_VALUE_LITERAL, ptr, end, nextTokPtr)
# define
XmlNameMatchesAscii
(
enc
,
ptr1
,
end1
,
ptr2
) \
(((enc)->nameMatchesAscii)(enc, ptr1, end1, ptr2))
# define
XmlNameLength
(
enc
,
ptr
) (((enc)->nameLength)(enc, ptr))
# define
XmlSkipS
(
enc
,
ptr
) (((enc)->skipS)(enc, ptr))
# define
XmlGetAttributes
(
enc
,
ptr
,
attsMax
,
atts
) \
(((enc)->getAtts)(enc, ptr, attsMax, atts))
# define
XmlCharRefNumber
(
enc
,
ptr
) (((enc)->charRefNumber)(enc, ptr))
# define
XmlPredefinedEntityName
(
enc
,
ptr
,
end
) \
(((enc)->predefinedEntityName)(enc, ptr, end))
# define
XmlUpdatePosition
(
enc
,
ptr
,
end
,
pos
) \
(((enc)->updatePosition)(enc, ptr, end, pos))
# define
XmlIsPublicId
(
enc
,
ptr
,
end
,
badPtr
) \
(((enc)->isPublicId)(enc, ptr, end, badPtr))
# define
XmlUtf8Convert
(
enc
,
fromP
,
fromLim
,
toP
,
toLim
) \
(((enc)->utf8Convert)(enc, fromP, fromLim, toP, toLim))
# define
XmlUtf16Convert
(
enc
,
fromP
,
fromLim
,
toP
,
toLim
) \
(((enc)->utf16Convert)(enc, fromP, fromLim, toP, toLim))
typedef
struct
{
ENCODING
initEnc
;
const
ENCODING
*
*
encPtr
;
}
INIT_ENCODING
;
int
XmlParseXmlDecl
(
int
isGeneralTextEntity
,
const
ENCODING
*
enc
,
const
char
*
ptr
,
const
char
*
end
,
const
char
*
*
badPtr
,
const
char
*
*
versionPtr
,
const
char
*
*
versionEndPtr
,
const
char
*
*
encodingNamePtr
,
const
ENCODING
*
*
namedEncodingPtr
,
int
*
standalonePtr
);
int
XmlInitEncoding
(
INIT_ENCODING
*
p
,
const
ENCODING
*
*
encPtr
,
const
char
*
name
);
const
ENCODING
*
XmlGetUtf8InternalEncoding
(
void
);
const
ENCODING
*
XmlGetUtf16InternalEncoding
(
void
);
int
XmlUtf8Encode
(
int
charNumber
,
char
*
buf
);
int
XmlUtf16Encode
(
int
charNumber
,
unsigned short
*
buf
);
int
XmlSizeOfUnknownEncoding
(
void
);
typedef
int
(
XMLCALL
*
CONVERTER
)(
void
*
userData
,
const
char
*
p
);
ENCODING
*
XmlInitUnknownEncoding
(
void
*
mem
,
const
int
*
table
,
CONVERTER
convert
,
void
*
userData
);
int
XmlParseXmlDeclNS
(
int
isGeneralTextEntity
,
const
ENCODING
*
enc
,
const
char
*
ptr
,
const
char
*
end
,
const
char
*
*
badPtr
,
const
char
*
*
versionPtr
,
const
char
*
*
versionEndPtr
,
const
char
*
*
encodingNamePtr
,
const
ENCODING
*
*
namedEncodingPtr
,
int
*
standalonePtr
);
int
XmlInitEncodingNS
(
INIT_ENCODING
*
p
,
const
ENCODING
*
*
encPtr
,
const
char
*
name
);
const
ENCODING
*
XmlGetUtf8InternalEncodingNS
(
void
);
const
ENCODING
*
XmlGetUtf16InternalEncodingNS
(
void
);
ENCODING
*
XmlInitUnknownEncodingNS
(
void
*
mem
,
const
int
*
table
,
CONVERTER
convert
,
void
*
userData
);
#endif
/* not XmlTok_INCLUDED */
Footer
© 2026 GitHub, Inc.
Footer navigation
Terms
Privacy
Security
Status
Community
Docs
Contact
Manage cookies
Do not share my personal information
You cant perform that action at this time.
Web Proxy Viewer |
New URL
|
Original Page