TL;DR: How can I participate?
The 2021 Workshop on Meta-Learning will be a series of streamed pre-recorded talks + live question-and-answer (Q&A) periods, and poster sessions on Gather.Town. You will be able to participate by:
- Submitting a paper to the workshop!
- Accessing the livestream on our NeurIPS.cc virtual workshop page!
- Joining the Zoom to message questions to the moderator during the Q&As and panel discussion, also from the NeurIPS.cc virtual workshop page.
- Joining the poster sessions on Gather.Town.
- Watching the poster videos on the NeurIPS.cc virtual workshop page.
- Chatting with us and other participants on the MetaLearn 2021 Rocket.Chat!
- Asking panel discussion questions on sli.do.
News & Updates
- Tue. 12, 2021: The workshop schedule has been added!
- Sep. 15, 2021: We have added a reviewing guideline for both junior and senior reviewers and removed the 10-page appendix limit.
- Sep. 14, 2021: We extended the paper submission deadline to September 29th.
- Sep. 5, 2021: We added a note to formatting, stating that we explicitly encourage shorter than 8-page submissions.
- Aug. 25, 2021: OpenReview open for submissions! Reviewing mentorship sign-up & recommendation form released!
Recent years have seen rapid progress in meta-learning methods, which transfer knowledge across tasks and domains to efficiently learn new tasks, optimize the learning process itself, and even generate new learning methods from scratch. Meta-learning can be seen as the logical conclusion of the arc that machine learning has undergone in the last decade, from learning classifiers, to learning representations, and finally to learning algorithms that themselves acquire representations, classifiers, and policies for acting in environments. In practice, meta-learning has been shown to yield new state-of-the-art automated machine learning methods, novel deep learning architectures, and substantially improved one-shot learning systems. Moreover, improving one’s own learning capabilities through experience can also be viewed as a hallmark of intelligent beings, and neuroscience shows a strong connection between human and reward learning and the growing sub-field of meta-reinforcement learning.
Some of the fundamental questions that this workshop aims to address are:
- How can we exploit our domain knowledge to guide the meta-learning process and make it more efficient? • What are the meta-learning processes in nature (e.g., in humans), and how can we take inspiration from them?
- Which machine learning approaches are best suited for meta-learning, in which circumstances, and why?
- What principles can we learn from meta-learning to help us design the next generation of learning systems?
In this year’s edition of the workshop, we propose the workshop to have the following four foci, which are informed by recent developments in meta-learning:
- Are there broadly applicable desiderata for meta-learning algorithms (e.g., modularity, interpretability), or is this more a function of the application domain?
- Can we derive entirely new and generally applicable machine learning components (e.g., architectural blocks, learning rate schedules, optimizers, task sets) by meta-learning, and can they transfer to very different tasks?
- Can we derive prescriptions for algorithm design by looking at the properties of meta-learned systems?
- What is unique and common amongst various meta-learning settings, including few-shot learning, architecture search, hyperparameter optimization, etc.?
As prospective participants, we primarily target machine learning researchers interested in the questions and foci outlined above. Specific target communities within machine learning include, but are not limited to: meta-learning, AutoML, reinforcement learning, deep learning, optimization, evolutionary computation, and Bayesian optimization. We also invite submissions from researchers who study human learning and neuroscience, to provide a broad and interdisciplinary perspective to the attendees.
- Carlo Ciliberto (UCL)
- Rosemary Ke (DeepMind)
- Luke Metz (Google)
- Mihaela van der Schaar (University of Cambridge)
- Eleni Triantafillou (University of Toronto)
- Ying Wei (City University of Hong Kong)
- Fábio Ferreira (Freiburg University)
- Erin Grant (UC Berkeley)
- Frank Hutter (Freiburg University)
- Jonathan Schwarz (University College London, Deepmind)
- Joaquin Vanschoren (Eindhoven University of Technology)
- Huaxiu Yao (Stanford)
The workshop schedule is aligned with 11 AM to 8.30 PM UTC+1; please see this converter for conversion to your specific time zone.
|Beijing (CST)||Berlin (CET)||London (UTC+1)||New York (EST)||Vancouver (PST)|
|19:00||12:00||11:00||06:00||03:00||Introduction and opening remarks|
|19:10||12:10||11:10||06:10||03:10||Invited talk 1: Ying Wei|
|19:40||12:40||11:40||06:40||03:40||Contributed talk 1: TBA|
|20:00||13:00||12:00||07:00||04:00||Poster session 1|
|21:00||14:00||13:00||08:00||05:00||Invited talk 2: Carlo Ciliberto|
|21:30||14:30||13:30||08:30||05:30||Invited talk 3: Mihaela van der Schaar|
|23:00||16:00||15:00||10:00||07:00||Poster session 2|
|00:00||17:00||16:00||11:00||08:00||Contributed talk 2: TBA|
|00:20||17:20||16:20||11:20||08:20||Invited talk 4: Nan Rosemary Ke|
|00:50||17:50||16:50||11:50||08:50||Poster session 3|
|02:00||19:00||18:00||13:00||10:00||Invited talk 5: Luke Metz|
|02:30||19:30||18:30||13:30||10:30||Invited talk 6: Eleni Triantafillou|
|03:00||20:00||19:00||14:00||11:00||Contributed talk 3: TBA|
|03:20||20:20||19:20||14:20||11:20||Poster session 3:|
tl;dr: Please submit via the workshop OpenReview submission page at https://openreview.net/group?id=NeurIPS.cc/2021/Workshop/MetaLearn.
To make it easier to find the posters, we marked posters in the Gather.Town rooms by increasing number; the list of posters below for each session is ordered by their position in the room. Paid NeurIPS.cc registration is required to access the Gather.Town poster rooms.
- Submission deadline: September 29th, 2021, 11:59 PM AoE
- Author Notification: October 22nd, 2021, AoE
- Video recording to SlidesLive: November 1st, 2021, AoE
- Camera-ready submission (paper + poster) to OpenReview: November 29th, 2021, AoE
- Workshop: December 13th, 2021
We have provided a modified
.sty file here that appropriately lists the name of the workshop when
\neuripsfinal is enabled. Please use this style file in conjunction with the corresponding LaTeX
.tex template from the NeurIPS website to submit a final camera-ready copy. Both the submission and the camera-ready can be up to 8 pages (excluding references) and we explicitly encourage submitting works shorter than 8 pages (e.g., works that may show preliminary but novel results).
Accepted papers and supplementary material will be made available on the workshop website. However, these do not constitute archival publications and no formal workshop proceedings will be made available, meaning contributors are free to publish their work in archival journals or conferences.
Can supplementary material be added beyond the 8-page limit for submissions, and are there any restrictions on it?
Yes, you may include additional supplementary material, but you should ensure that the main paper is self-contained, since looking at supplementary material is at the discretion of the reviewers. The supplementary material should also follow the same NeurIPS format as the paper.
Are references included in the 8-page limit?
No, references will not count towards the page limit.
Can a submission to this workshop be submitted to another NeurIPS workshop in parallel?
We discourage this, as it leads to more work for reviewers across multiple workshops. Our suggestion is to pick one workshop to submit to.
Can a paper be submitted to the workshop that has already appeared at a previous conference with published proceedings?
We won’t be accepting such submissions unless they have been adapted to contain significantly new results (where novelty is one of the qualities reviewers will be asked to evaluate).
Can a paper be submitted to the workshop that is currently under review or will be under review at a conference during the review phase?
From our side, it is perfectly fine to submit a condensed version of a parallel conference submission if it is also fine for the conference in question. Our workshop does not have archival proceedings, and therefore parallel submissions of extended versions to other conferences are acceptable.
tl;dr: The review process will be double-blind. Please sign up to be, or recommend, a reviewer via https://forms.gle/EW4icbYv5uA8A13KA.
- Reviewer signup deadline: September 29th, 2021, AoE
- Assignments of reviewers to papers (start of review phase): October 1st, 2021
- Active discussion between junior & senior reviewers: October 1st to 15th, 2021
- First draft of review by junior reviewers: October 8th, 2021
- Final reviewing deadline: October 15th, 2021, AoE
We encourage all reviewers, both junior and senior, to check our reviewing guidelines.
Last year we trialed a new reviewer mentorship scheme aiming to improve the future pool of expert reviewers in machine learning. 61 Junior reviewers provided reviews guided by 39 senior reviewers, who gave them feedback and advice throughout the reviewing process. The program was a success with lots of discussion behind the scenes, and we’re excited to renew the program this year.
If you would like to sign up, or recommend somebody, to be either a junior or senior reviewer, please fill out this form by 29 September 2021.
Additionally, all submissions will be asked to provide two contacts who have agreed to review for the workshop. These volunteers can, of course, be authors of the submission, or people who have agreed to review on behalf of the authors. Depending on their experience reviewing, these contacts will be assigned to either a junior or senior reviewer role. All submissions will be ensured at least one senior reviewer, since we will still be directly recruiting for reviewers as in previous years.
Workshop on Meta-Learning (MetaLearn 2017) @ NeurIPS 2017
Workshop on Meta-Learning (MetaLearn 2018) @ NeurIPS 2018
Workshop on Meta-Learning (MetaLearn 2019) @ NeurIPS 2019
Workshop on Meta-Learning (MetaLearn 2020) @ NeurIPS 2020
For any further questions, you can contact us at firstname.lastname@example.org.