Model description
This model is built using two important architectural components proposed by Bryan Lim et al. in Temporal Fusion Transformers (TFT) for Interpretable Multi-horizon Time Series Forecasting called GRN and VSN which are very useful for structured data learning tasks.
- Gated Residual Networks(GRN): consists of skip connections and gating layers that facilitate information flow efficiently. They have the flexibility to apply non-linear processing only where needed.
GRNs make use of Gated Linear Units (or GLUs) to suppress the input that are not relevant for a given task.
The GRN works as follows:- It first applies Non-linear ELU tranformation on its inputs
- It then applies a linear transformation followed by dropout
- Next it applies GLU and adds the original inputs to the output of the GLU to perform skip (residual) connection
- Finally, it applies layer normalization and produces its output
- Variable Selection Networks(VSN): help in carefully selecting the most important features from the input and getting rid of any unnecessary noisy inputs which could harm the model’s performance.
The VSN works as follows:- First, it applies a Gated Residual Network (GRN) to each feature individually.
- Then it concatenates all features and applies a GRN on the concatenated features, followed by a softmax to produce feature weights
- It produces a weighted sum of the output of the individual GRN
Note: This model is not based on the whole TFT model described in the mentioned paper on top but only uses its GRN and VSN components demonstrating that GRN and VSNs can be very useful on their own also for structured data learning tasks.
Intended uses
This model can be used for binary classification task to determine whether a person makes over $500K a year or not.
Training and evaluation data
This model was trained using the United States Census Income Dataset provided by the UCI Machine Learning Repository.
The dataset consists of weighted census data containing demographic and employment related variables extracted from 1994 and 1995 Current Population Surveys conducted by the US Census Bureau.
The dataset comprises of ~299K samples with 41 input variables and 1 target variable called income_level
The variable instance_weight is not used as an input for the model so finally the model uses 40 input features containing 7 numerical features and 33 categorical features:
Numerical Features | Categorical Features |
---|---|
age | class of worker |
wage per hour | industry code |
capital gains | occupation code |
capital losses | adjusted gross income |
dividends from stocks | education |
num persons worked for employer | veterans benefits |
weeks worked in year | enrolled in edu inst last wk |
marital status | |
major industry code | |
major occupation code | |
mace | |
hispanic Origin | |
sex | |
member of a labor union | |
reason for unemployment | |
full or part time employment stat | |
federal income tax liability | |
tax filer status | |
region of previous residence | |
state of previous residence | |
detailed household and family stat | |
detailed household summary in household | |
migration code-change in msa | |
migration code-change in reg | |
migration code-move within reg | |
live in this house 1 year ago | |
migration prev res in sunbelt | |
family members under 18 | |
total person earnings | |
country of birth father | |
country of birth mother | |
country of birth self | |
citizenship | |
total person income | |
own business or self employed | |
taxable income amount | |
fill inc questionnaire for veteran’s admin |
收录说明:
1、本网页并非 keras-io/structured-data-classification-grn-vsn 官网网址页面,此页面内容编录于互联网,只作展示之用;2、如果有与 keras-io/structured-data-classification-grn-vsn 相关业务事宜,请访问其网站并获取联系方式;3、本站与 keras-io/structured-data-classification-grn-vsn 无任何关系,对于 keras-io/structured-data-classification-grn-vsn 网站中的信息,请用户谨慎辨识其真伪。4、本站收录 keras-io/structured-data-classification-grn-vsn 时,此站内容访问正常,如遇跳转非法网站,有可能此网站被非法入侵或者已更换新网址,导致旧网址被非法使用,5、如果你是网站站长或者负责人,不想被收录请邮件删除:i-hu#Foxmail.com (#换@)
前往AI网址导航
2、本站所有文章、图片、资源等如果未标明原创,均为收集自互联网公开资源;分享的图片、资源、视频等,出镜模特均为成年女性正常写真内容,版权归原作者所有,仅作为个人学习、研究以及欣赏!如有涉及下载请24小时内删除;
3、如果您发现本站上有侵犯您的权益的作品,请与我们取得联系,我们会及时修改、删除并致以最深的歉意。邮箱: i-hu#(#换@)foxmail.com