Skip to content

14 annual embed#39

Merged
SarahAlidoost merged 10 commits intomainfrom
14_annual_embed
Apr 28, 2026
Merged

14 annual embed#39
SarahAlidoost merged 10 commits intomainfrom
14_annual_embed

Conversation

@meiertgrootes
Copy link
Copy Markdown
Collaborator

This pull request replaces positional encoding in time with a day-of-year (and hour-of-day) based temporal embedding.
This is expected to improve training results, in particular when using multiple years of data.

Copy link
Copy Markdown
Member

@SarahAlidoost SarahAlidoost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@meiertgrootes thanks! this is very useful as now the model can capture seasonality/diurnal cycles. I left some comments. The major one is about how the Fourier time encoding is currently implemented, see my comments and let me know if something isn't clear.

Comment thread climanet/st_encoder_decoder.py
Comment thread climanet/st_encoder_decoder.py Outdated
Comment thread climanet/st_encoder_decoder.py Outdated
Comment thread climanet/st_encoder_decoder.py Outdated
Comment thread climanet/st_encoder_decoder.py Outdated
Comment thread climanet/utils.py Outdated
Comment thread climanet/utils.py Outdated
Comment thread climanet/utils.py Outdated
Comment thread climanet/dataset.py Outdated
Comment thread climanet/dataset.py Outdated
@rogerkuou
Copy link
Copy Markdown
Collaborator

@meiertgrootes as I indicated in the Teams message I wont have time in the comming days to review this. I am fine with merging on Sarah's approval!

@meiertgrootes
Copy link
Copy Markdown
Collaborator Author

@SarahAlidoost I've addressed and incorporated your comments. Thanks for the thorough review.

Copy link
Copy Markdown
Member

@SarahAlidoost SarahAlidoost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@meiertgrootes Looks very good, Thanks for addressing the comments! 👍 I'll merge this.

@SarahAlidoost SarahAlidoost merged commit f558f80 into main Apr 28, 2026
3 checks passed
@SarahAlidoost SarahAlidoost deleted the 14_annual_embed branch April 28, 2026 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants