Bob Williamson

Bob

I am professor of foundations of machine learning systems at the University of Tübingen. I am a principal investigator in the Tübingen AI center and a member of the Cluster of Excellence Machine Learning in the Sciences.

Current Research

My current research is focused on a small number of basic questions underpinning much of Machine Learning. Most of this is being done with PhD students and postdocs in the FMLS group.

  • How should one aggregate?  The average is the usual answer. There are, however, many other choices, which are better suited from questions arising from fairness considerations, ambiguity of information, and instability of relative frequencies.
  • How can one conceptualise intersectionality mathematically, whereby just because events \(A\) and \(B\) have probabilities associated with them does not imply that \(A \cap B\) should too? More generally, how can one extend Richard von Mises theory of collectives to situations where relative frequencies do not converge.
  • Understanding information. Classical information theory largely works with Shannon information. The Csiszár \(f\)-divergences show there are other choices. What else is possible? And how does information relate to the risk in learning problems? And how can one extend notions of information to situations where one cannot talk of probabilities (e.g. when relative frequencies do not converge).
  • Understanding selection bias and more complex corruptions of data. Learning with different types of noise (eg label noise) is now becoming quite well understood. However, when one allows that the corruption process can depend jointly on labels and attributes far greater problems arise. This has been demonstrated in a simple case by Xiao-Li Meng. I am exploring how to extend this to more general situations.
  • The style of reasoning of machine learning. Machine learning is often viewed as pure empiricism, but this is a deeply flawed perspective. With Atoosa Kasirzadeh I am exploring the style of reasoning of ML (in the sense of Ian Hacking's use of styles of reasoning)

Past Research

See my older papers on Google Scholar.

Teaching

I have taught two courses whilst in Tübingen:

Beyond Fairness: A Socio-Technical View of Machine Learning

This was taught in Winter Semester 2021/2 and will be taught again in WS 2023/4. It is a Masters course that starts off by looking at various mathematisations of fairness in ML, and proceeds to examine many other more general issues, in particular the role of data and categorisation. A wide literature is drawn from and the assessment is a team term paper.

Information Theory

This was taught in WS 2022/3 and is a Bachelor course that covers the source and channel coding theorems and the role of information theory in machine learning.

Bio

Born 1962. PhD (UQ) 1990. Co-created NICTAFAA 2012. ANU 1990-2020. Moved to Germany in 2021.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Photography