Human Generated Data

Title

Untitled (woman playing piano in crowd)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4431

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman playing piano in crowd)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.1
Person 95.2
Person 94.5
Apparel 89.9
Clothing 89.9
Person 87.1
Person 86.7
Person 74
Person 72.9
People 72.9
Person 69.3
Person 65.8
Person 62.6
Crowd 62.3
Person 61.6
Face 61.5
Person 44.9

Imagga
created on 2022-01-23

newspaper 21.5
person 18.8
business 18.2
man 18.1
product 17
male 17
daily 16.9
technology 16.3
adult 15.7
looking 15.2
old 14.6
people 14.5
businessman 14.1
building 13.9
negative 13.9
creation 13.6
film 13.3
work 13.3
senior 13.1
sky 12.1
chart 11.5
construction 11.1
portrait 11
finance 11
shop 10.6
modern 10.5
billboard 10.5
cloud 10.3
city 10
hand 9.9
human 9.7
job 9.7
architecture 9.4
casual 9.3
professional 8.8
engineer 8.8
computer 8.8
happy 8.8
collage 8.7
education 8.7
mercantile establishment 8.6
classroom 8.6
signboard 8.6
customer 8.6
data 8.2
one 8.2
student 8.1
structure 8.1
lady 8.1
supermarket 8
builder 7.7
men 7.7
class 7.7
grunge 7.7
money 7.6
health 7.6
serious 7.6
toyshop 7.6
blackboard 7.6
plan 7.6
office 7.4
photographic paper 7.3
aged 7.2
smiling 7.2
lifestyle 7.2
smile 7.1
market 7.1
medical 7.1
happiness 7
indoors 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.4
person 90.6
ship 88.8
black and white 70.4
clothing 60.3

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 94.9%
Calm 99.7%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 96.5%
Sad 37.1%
Calm 22.7%
Happy 19.8%
Confused 6.3%
Fear 5.3%
Angry 4.6%
Disgusted 2.7%
Surprised 1.4%

AWS Rekognition

Age 23-33
Gender Female, 60.6%
Calm 97.1%
Confused 1.8%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%
Sad 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Female, 53.8%
Calm 38.4%
Sad 25.8%
Surprised 14.9%
Angry 7.8%
Confused 5.1%
Disgusted 4.3%
Fear 2.5%
Happy 1.2%

AWS Rekognition

Age 27-37
Gender Female, 90.4%
Calm 77.5%
Sad 7.2%
Fear 3.9%
Confused 3.5%
Surprised 2.3%
Disgusted 1.9%
Angry 1.9%
Happy 1.7%

AWS Rekognition

Age 35-43
Gender Female, 54.5%
Calm 88.9%
Confused 6.2%
Disgusted 1.6%
Surprised 1.1%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 59.5%
Surprised 16.8%
Angry 7.1%
Disgusted 6.4%
Confused 5.2%
Happy 3.2%
Sad 1.4%
Fear 0.4%

AWS Rekognition

Age 45-53
Gender Male, 89.1%
Happy 50.4%
Fear 32.3%
Angry 10.3%
Sad 2.3%
Surprised 1.6%
Calm 1.6%
Confused 0.9%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Male, 97.9%
Calm 90.9%
Sad 4.8%
Happy 2.7%
Angry 0.7%
Confused 0.3%
Surprised 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 35-43
Gender Female, 97.2%
Calm 89.7%
Happy 7.9%
Sad 1.3%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 87.7%
Calm 79.5%
Happy 8.5%
Disgusted 4.9%
Sad 3.3%
Confused 2%
Angry 0.8%
Surprised 0.7%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 90.3%
Sad 40%
Calm 23.7%
Disgusted 11.8%
Surprised 11.1%
Confused 5.9%
Happy 3.8%
Fear 2.1%
Angry 1.5%

AWS Rekognition

Age 39-47
Gender Female, 96.1%
Angry 28.7%
Happy 19.9%
Calm 16.1%
Surprised 13.4%
Disgusted 7.4%
Sad 6.6%
Fear 6.4%
Confused 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 72.4%
a group of people sitting at a table 67.7%
a group of people posing for the camera 67.6%

Text analysis

Amazon

17245.
RODVY
38
EVEETA

Google

.2ר
5
. 5 .2ר (
(
.