folktexts
- folktexts package
- Subpackages
- Submodules
- folktexts.benchmark module
Benchmark
BenchmarkConfig
BenchmarkConfig.numeric_risk_prompting
BenchmarkConfig.few_shot
BenchmarkConfig.reuse_few_shot_examples
BenchmarkConfig.batch_size
BenchmarkConfig.context_size
BenchmarkConfig.correct_order_bias
BenchmarkConfig.feature_subset
BenchmarkConfig.population_filter
BenchmarkConfig.seed
BenchmarkConfig.batch_size
BenchmarkConfig.context_size
BenchmarkConfig.correct_order_bias
BenchmarkConfig.default_config()
BenchmarkConfig.feature_subset
BenchmarkConfig.few_shot
BenchmarkConfig.load_from_disk()
BenchmarkConfig.numeric_risk_prompting
BenchmarkConfig.population_filter
BenchmarkConfig.reuse_few_shot_examples
BenchmarkConfig.save_to_disk()
BenchmarkConfig.seed
BenchmarkConfig.update()
- folktexts.col_to_text module
- folktexts.dataset module
Dataset
Dataset.data
Dataset.filter()
Dataset.get_data_split()
Dataset.get_features_data()
Dataset.get_sensitive_attribute_data()
Dataset.get_target_data()
Dataset.get_test()
Dataset.get_train()
Dataset.get_val()
Dataset.name
Dataset.sample_n_train_examples()
Dataset.seed
Dataset.subsample()
Dataset.subsampling
Dataset.task
Dataset.test_size
Dataset.train_size
Dataset.val_size
- folktexts.evaluation module
- folktexts.llm_utils module
- folktexts.plotting module
- folktexts.prompting module
- folktexts.qa_interface module
Choice
DirectNumericQA
MultipleChoiceQA
MultipleChoiceQA.answer_keys
MultipleChoiceQA.choice_to_key
MultipleChoiceQA.choices
MultipleChoiceQA.create_answer_keys_permutations()
MultipleChoiceQA.create_question_from_value_map()
MultipleChoiceQA.get_answer_from_model_output()
MultipleChoiceQA.get_answer_from_text()
MultipleChoiceQA.get_answer_key_from_value()
MultipleChoiceQA.get_question_prompt()
MultipleChoiceQA.get_value_to_text_map()
MultipleChoiceQA.key_to_choice
MultipleChoiceQA.num_forward_passes
QAInterface
- folktexts.task module
TaskMetadata
TaskMetadata.check_task_columns_are_available()
TaskMetadata.cols_to_text
TaskMetadata.create_task_with_feature_subset()
TaskMetadata.description
TaskMetadata.direct_numeric_qa
TaskMetadata.features
TaskMetadata.get_row_description()
TaskMetadata.get_target()
TaskMetadata.get_task()
TaskMetadata.multiple_choice_qa
TaskMetadata.name
TaskMetadata.question
TaskMetadata.sensitive_attribute
TaskMetadata.sensitive_attribute_value_map()
TaskMetadata.set_question()
TaskMetadata.target
TaskMetadata.target_threshold
TaskMetadata.use_numeric_qa
- folktexts.threshold module
- Module contents