#ml
A family tree shows how transformers are evolving.
(HTML is probably the worst name for a model.)
https://arxiv.org/abs/2302.07730
A family tree shows how transformers are evolving.
(HTML is probably the worst name for a model.)
https://arxiv.org/abs/2302.07730
👍2
#ml
Hand-Crafted Transformers
HandCrafted.ipynb - Colaboratory
https://colab.research.google.com/github/newhouseb/handcrafted/blob/main/HandCrafted.ipynb
Hand-Crafted Transformers
HandCrafted.ipynb - Colaboratory
https://colab.research.google.com/github/newhouseb/handcrafted/blob/main/HandCrafted.ipynb
Google
HandCrafted.ipynb
Run, share, and edit Python notebooks
👍1
#visualization
https://climate.copernicus.eu/record-breaking-north-atlantic-ocean-temperatures-contribute-extreme-marine-heatwaves
https://climate.copernicus.eu/record-breaking-north-atlantic-ocean-temperatures-contribute-extreme-marine-heatwaves
climate.copernicus.eu
Record-breaking North Atlantic Ocean temperatures contribute to extreme marine heatwaves
Global average sea surface temperatures last month reached unprecedented levels for June. The north Atlantic Ocean recorded exceptionally warm sea surface temperatures, with several extreme marine heatwaves. These were related to short term changes in atmospheric…
😱1
#misc
https://avi-loeb.medium.com/we-have-discovered-spherules-from-the-path-of-the-first-recognized-interstellar-meteor-im1-d6cd94946b53
When I was doing my PhD, I spent a lot of hours on Loeb's papers. I was always hoping to see some evidence that there is already a party going on in the universe but we, as human beings, haven't found the way to chime in. I even wrote some stories on this idea, e.g.,
https://blog.leima.is/stories/dream-a-new-world/
I don't know. It is quite shameful to believe in something like this as an adult. But then again, who knows. At least I can have some fun.
https://avi-loeb.medium.com/we-have-discovered-spherules-from-the-path-of-the-first-recognized-interstellar-meteor-im1-d6cd94946b53
When I was doing my PhD, I spent a lot of hours on Loeb's papers. I was always hoping to see some evidence that there is already a party going on in the universe but we, as human beings, haven't found the way to chime in. I even wrote some stories on this idea, e.g.,
https://blog.leima.is/stories/dream-a-new-world/
I don't know. It is quite shameful to believe in something like this as an adult. But then again, who knows. At least I can have some fun.
Medium
We Have Discovered Spherules from the Path of the First Recognized Interstellar Meteor, IM1
Diary of an Interstellar Voyage, Report 20 (June 21, 2023)
🥰1
#timeseries
Another work on pre-trained large models for time series.
https://github.com/DAMO-DI-ML/NeurIPS2023-One-Fits-All
Another work on pre-trained large models for time series.
https://github.com/DAMO-DI-ML/NeurIPS2023-One-Fits-All
GitHub
GitHub - DAMO-DI-ML/NeurIPS2023-One-Fits-All: The official code for "One Fits All: Power General Time Series Analysis by Pretrained…
The official code for "One Fits All: Power General Time Series Analysis by Pretrained LM (NeurIPS 2023 Spotlight)" - DAMO-DI-ML/NeurIPS2023-One-Fits-All
👍1
#llm
You probably heard of the famous ChatDev (https://github.com/OpenBMB/ChatDev ) that works like a whole company with all sorts of employees solving different parts of a complicated problem. If not, checkout the video demo in the GitHub repo.
Now, Microsoft joined the game. They built a framework for such models. The screenshot attached is a demo from the documentation. I tried it, and it is super easy to get started.
https://github.com/microsoft/autogen
You probably heard of the famous ChatDev (https://github.com/OpenBMB/ChatDev ) that works like a whole company with all sorts of employees solving different parts of a complicated problem. If not, checkout the video demo in the GitHub repo.
Now, Microsoft joined the game. They built a framework for such models. The screenshot attached is a demo from the documentation. I tried it, and it is super easy to get started.
https://github.com/microsoft/autogen
🔥1
#misc
Thinking about the past few days, I realized I never used stackoverflow during work. Our company pays for our github copilot services so I completely switched to the copilot chats.
So sad but I think I can totally live in a world without stackoverflow nowadays.
https://www.theverge.com/2023/10/16/23919004/stack-overflow-layoff-ai-profitability
Thinking about the past few days, I realized I never used stackoverflow during work. Our company pays for our github copilot services so I completely switched to the copilot chats.
So sad but I think I can totally live in a world without stackoverflow nowadays.
https://www.theverge.com/2023/10/16/23919004/stack-overflow-layoff-ai-profitability
The Verge
Stack Overflow lays off over 100 people as the AI coding boom continues
Stack Overflow just doubled its staff last year.
😢2
#dl
Google & USC benchmarked a prompt based forecasting method, and the results are amazing.
Cao D, Jia F, Arik SO, Pfister T, Zheng Y, Ye W, et al. TEMPO: Prompt-based Generative Pre-trained Transformer for time series forecasting. arXiv [cs.LG]. 2023. Available: http://arxiv.org/abs/2310.04948
Google & USC benchmarked a prompt based forecasting method, and the results are amazing.
Cao D, Jia F, Arik SO, Pfister T, Zheng Y, Ye W, et al. TEMPO: Prompt-based Generative Pre-trained Transformer for time series forecasting. arXiv [cs.LG]. 2023. Available: http://arxiv.org/abs/2310.04948
👍1
#fun
There are normal and professional contests, and then this:
The International Obfuscated C Code Contest
https://ioccc.org/
Alright, someone please host a Python version of it. It could go completely wild.
There are normal and professional contests, and then this:
The International Obfuscated C Code Contest
https://ioccc.org/
Alright, someone please host a Python version of it. It could go completely wild.
🤬2