Penn State researchers create artificial intelligence tool to detect discrimination

A new artificial intelligence (AI) tool for detecting unfair discrimination--such as on the basis of race or gender--has been created by researchers at Penn State and Columbia University.

Preventing unfair treatment of individuals on the basis of race, gender or ethnicity, for example, been a long-standing concern of civilized societies. However, detecting such discrimination resulting from decisions, whether by human decision makers or automated AI systems, can be extremely challenging. This challenge is further exacerbated by the wide adoption of AI systems to automate decisions in many domains--including policing, consumer finance, higher education and business. {module In-article}

"Artificial intelligence systems--such as those involved in selecting candidates for a job or for admission to a university--are trained on large amounts of data," said Vasant Honavar, Professor and Edward Frymoyer Chair of Information Sciences and Technology, Penn State. "But if these data are biased, they can affect the recommendations of AI systems."

For example, he said, if a company historically has never hired a woman for a particular type of job, then an AI system trained on this historical data will not recommend a woman for a new job.

"There's nothing wrong with the machine learning algorithm itself," said Honavar. "It's doing what it's supposed to do, which is to identify good job candidates based on certain desirable characteristics. But since it was trained on historical, biased data it has the potential to make unfair recommendations."

The team created an AI tool for detecting discrimination with respect to a protected attribute, such as race or gender, by human decision makers or AI systems that is based on the concept of causality in which one thing--a cause--causes another thing--an effect.

"For example, the question, 'Is there gender-based discrimination in salaries?' can be reframed as, 'Does gender have a causal effect on salary?,' or in other words, 'Would a woman be paid more if she was a man?' said Aria Khademi, graduate student in information sciences and technology, Penn State.

Since it is not possible to directly know the answer to such a hypothetical question, the team's tool uses sophisticated counterfactual inference algorithms to arrive at a best guess.

"For instance," said Khademi, "one intuitive way of arriving at a best guess as to what a fair salary would be for a female employee is to find a male employee who is similar to the woman with respect to qualifications, productivity and experience. We can minimize gender-based discrimination in salary if we ensure that similar men and women receive similar salaries."

The researchers tested their method using various types of available data, such as income data from the U.S. Census Bureau to determine whether there is gender-based discrimination in salaries. They also tested their method using the New York City Police Department's stop-and-frisk program data to determine whether there is discrimination against people of color in arrests made after stops. The results appeared in May in Proceedings of The Web Conference 2019.

"We analyzed an adult income data set containing salary, demographic and employment-related information for close to 50,000 individuals," said Honavar. "We found evidence of gender-based discrimination in salary. Specifically, we found that the odds of a woman having a salary greater than $50,000 per year is only one-third that for a man. This would suggest that employers should look for and correct, when appropriate, gender bias in salaries."

Although the team's analysis of the New York stop-and-frisk dataset--which contains demographic and other information about drivers stopped by the New York City police force--revealed evidence of possible racial bias against Hispanics and African American individuals, it found no evidence of discrimination against them on average as a group.

"You cannot correct for a problem if you don't know that the problem exists," said Honavar. "To avoid discrimination on the basis of race, gender or other attributes you need effective tools for detecting discrimination. Our tool can help with that."

Honavar added that as data-driven artificial intelligence systems increasingly determine how businesses target advertisements to consumers, how police departments monitor individuals or groups for criminal activity, how banks decide who gets a loan, who employers decide to hire, and how colleges and universities decide who gets admitted or receives financial aid, there is an urgent need for tools such as the one he and his colleagues developed.

"Our tool," he said, "can help ensure that such systems do not become instruments of discrimination, barriers to equality, threats to social justice and sources of unfairness."

International research team develops new method that translates results from climate supercomputer models to probabilities of an ice-free Arctic

Scientists from South Korea, Australia and the USA used results from climate models and a new statistical approach to calculate the likelihood for Arctic sea ice to disappear at different warming levels

Research published in this week's issue of Nature Communications reveals a considerable chance for an ice-free Arctic Ocean at global warming limits stipulated in the Paris Agreement. Scientists from South Korea, Australia and the USA used results from climate models and a new statistical approach to calculate the likelihood for Arctic sea ice to disappear at different warming levels. 

Future climate projections are usually obtained from global climate supercomputer models. These models are based on several hundred thousand lines of computer code, developed to solve the physical equations of the atmosphere, ocean, sea-ice and other climate components. Applying future greenhouse gas concentrations, each computer model produces a version of what the future of the Earth's climate might look like. Transforming this information into practical decisions is not easy, because of the remaining uncertainties in the magnitude of future climate change on regional scales. Decision making in a warming world requires an understanding of the probabilities of certain climatic events to occur.  {module In-article}

Up to now, it has been difficult to extract meaningful probabilities from climate models, because these models sometimes share common computer code or make similar assumptions regarding the implementation of less well understood processes, such as clouds or vegetation. To obtain more accurate probability estimates for future climate change in the Arctic region, the research team has developed a novel statistical method which translates results from a suite of climate supercomputer model simulations to probabilities. This method ranks the models in terms of how well they agree with present-day observations and accounts also for inter-dependencies amongst the models.

"Translating model dependence into mathematical equations has been a long-standing issue in climate science. It is exciting to see that our method can provide a general framework to solve this problem," said coauthor Won Chang, assistant professor in the department of Mathematical Sciences at the University of Cincinnati, USA. 

The researchers applied the new statistical method to climate model projections of the 21st century. Using 31 different climate models, which exhibit considerable inter-dependence, the authors find that there is at least a 6% probability that summer sea ice in the Arctic Ocean will disappear at 1.5 °C warming above preindustrial levels - a lower limit recommended by the Paris Agreement of the United Nations Framework Convention on Climate Change (Figure 1). For a 2°C warming, the probability for losing the ice rises to at least 28%. Most likely we will see a sea ice-free summer Arctic Ocean for the first time at 2 to 2.5°C warming. 

"Our work provides a new statistical and mathematical framework to calculate climate change and impact probabilities," commented Jason Evans, professor at the Climate Change Research Center in UNSW Australia in Sydney.

"Up to now, there was no established mathematical framework to assign probabilities on non-exclusive theories. While we only tested the new approach on climate models, we are eager to see if the technique can be applied to other fields, such as stock market predictions, plane accident investigations, or in medical research", says Roman Olson, the lead author and researcher at the Institute for Basic Science, Center for Climate Physics (ICCP) in South Korea.

Australian researchers show first observation of native ferroelectric metal

tungsten ditelluride shows bistable and electrically switchable spontaneous polarization states; potential for new nano-electronics applications

In a paper released today in Science Advances, UNSW researchers describe the first observation of a native ferroelectric metal.

The study represents the first example of a native metal with bistable and electrically switchable spontaneous polarization states - the hallmark of ferroelectricity.

"We found the coexistence of native metallicity and ferroelectricity in bulk crystalline tungsten ditelluride (WTe2) at room temperature," explains study author Dr. Pankaj Sharma. Ferroelectric domains in a WTe2 single crystal (PFM imaging).{module In-article}

"We demonstrated that the ferroelectric state is switchable under an external electrical bias and explain the mechanism for 'metallic ferroelectricity' in WTe2 through a systematic study of the crystal structure, electronic transport measurements, and theoretical considerations."

"A van der Waals material that is both metallic and ferroelectric in its bulk crystalline form at room temperature has the potential for new nano-electronics applications," says author Dr. Feixiang Xiang.

FERROELECTRIC BACKGROUNDER

Ferroelectricity can be considered an analogy to ferromagnetism. A ferromagnetic material displays permanent magnetism, and in layperson's terms, is simply, a 'magnet' with north and south pole. Ferroelectric material likewise displays an analogous electrical property called a permanent electric polarisation, which originates from electric dipoles consisting of equal, but oppositely charged ends or poles. In ferroelectric materials, these electric dipoles exist at the unit cell level and give rise to a non-vanishing permanent electric dipole moment.

This spontaneous electric dipole moment can be repeatedly transitioned between two or more equivalent states or directions upon application of an external electric field - a property utilised in numerous ferroelectric technologies, for example nano-electronic computer memory, RFID cards, medical ultrasound transducers, infrared cameras, submarine sonar, vibration and pressure sensors, and precision actuators.

Conventionally, ferroelectricity has been observed in materials that are insulating or semiconducting rather than metallic, because of conduction electrons in metals screen-out the static internal fields arising from the dipole moment. This is a model of tungsten ditelluride WTe2 crystals in a layered, orthorhombic structure.

THE STUDY

A room-temperature ferroelectric semimetal was published in Science Advances in July 2019.

Bulk single-crystalline tungsten ditelluride (WTe2), which belongs to a class of materials known as transition metal dichalcogenides (TMDCs), was probed by spectroscopic electrical transport measurements, conductive-atomic force microscopy (c-AFM) to confirm its metallic behavior, and by piezo-response force microscopy (PFM) to map the polarisation, detecting lattice deformation due to an applied electric field.

Ferroelectric domains - ie, the regions with the oppositely oriented direction of polarization - were directly visualized in freshly-cleaved WTe2 single crystals.

Spectroscopic-PFM measurements with a top electrode in a capacitor geometry were used to demonstrate switching of the ferroelectric polarization.

The study was supported by funding from the Australian Research Council through the ARC Centre of Excellence in Future Low-Energy Electronics Technologies (FLEET), and the work was performed in part using facilities of the NSW Nodes of the Australian National Fabrication Facility, with the assistance of the Australian Government Research Training Program Scholarship scheme.

First-principles density functional theory (DFT) calculations (University of Nebraska) confirmed the experimental findings of the electronic and structural origins of the ferroelectric instability of WTe2, supported by the National Science Foundation.

FERROELECTRIC STUDIES AT FLEET

Ferroelectric materials are keenly studied at FLEET (the ARC Centre of Excellence in Future Low-Energy Electronics Technologies) for their potential use in low-energy electronics, 'beyond CMOS' technology.

The switchable electric dipole moment of ferroelectric materials could, for example, be used as a gate for the underlying 2D electron system in an artificial topological insulator.

In comparison with conventional semiconductors, the very close (sub-nanometre) proximity of a ferroelectric's electron dipole moment to the electron gas in the atomic crystal ensures more effective switching, overcoming limitations of conventional semiconductors where the conducting channel is buried tens of nanometres below the surface.

Topological materials are investigated within FLEET's Research theme 1, which seeks to establish ultra-low resistance electronic paths with which to create a new generation of ultra-low energy electronics.

FLEET is an ARC-funded research center bringing together over a hundred Australian and international experts to develop a new generation of ultra-low energy electronics, motivated by the need to reduce the energy consumed by supercomputing.