huggingface transformers 源码剖析(一)

Table of Contents

1. Logging

transformers也提供了logging功能,类似于python标准库中的实现。我还是建议使用默认的python库中的logging,你可以在这里找到相关信息。如果你还是想使用transformers.logging做日志,那么你可以使用以下API:

import transformers.logging as logging

# ## get logger
# logging.get_logger()

## set level
logging.set_verbosity_error()
logging.set_verbosity_warning()
logging.set_verbosity_info()
logging.set_verbosity_debug()

logging.set_verbosity(p) # where p can be int: 10(debug),20(info),30(warning),40(error),50(critical)
# you can get the int value by logging.DEBUG, logging.INFO, ...

## get level
logging.get_verbosity()

2. Tokenizer

3. Models

4. Model outputs

5. Optimization

6. Configuration

7. Processors

8. Callbacks

9. Pipelines


Author: Zi Liang (liangzid@stu.xjtu.edu.cn) Create Date: Tue Nov 23 15:37:36 2021 Last modified: 2024-03-09 Sat 20:56 Creator: Emacs 28.1 (Org mode 9.5.2)