Human Generated Data

Title

Untitled (man and boy making faces on stage in front of audience)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7020

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and boy making faces on stage in front of audience)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Person 99.5
Person 98.6
Clothing 98.3
Apparel 98.3
Footwear 98.3
Shoe 98.3
Person 98
Shoe 96.8
Person 96.3
Person 94.6
Person 92.6
Person 87.2
Shoe 84.7
People 84.3
Shorts 84.3
Asphalt 82.2
Tarmac 82.2
Road 77.8
Person 75.7
Person 67.4
Home Decor 66.2
Linen 61.7
Portrait 60.5
Face 60.5
Photo 60.5
Photography 60.5
Hockey 59.3
Team 59.3
Sport 59.3
Team Sport 59.3
Sports 59.3
Person 59.2
Field 55.3
Person 48.6

Imagga
created on 2021-12-15

people 31.8
business 28.5
person 27.5
professional 25.8
businessman 23
man 22.2
office 21.9
adult 20.3
laboratory 20.3
corporate 19.8
work 19.7
nurse 19.4
businesspeople 19
team 18.8
job 18.6
medical 18.5
male 18.4
negative 17.9
working 17.7
businesswoman 16.4
research 16.2
group 16.1
table 16.1
technology 15.6
suit 15
film 15
medicine 15
lab 14.6
worker 14.6
science 14.2
manager 14
glass 13.5
women 13.4
indoors 13.2
executive 13
success 12.9
computer 12.8
human 12.7
happy 12.5
test 12.5
biology 12.3
desk 12.3
portrait 12.3
meeting 12.2
doctor 12.2
teamwork 12.1
glasses 12
successful 11.9
confident 11.8
health 11.8
experiment 11.7
scientific 11.6
photographic paper 11.6
formal 11.5
men 11.2
scientist 10.8
chemical 10.8
room 10.4
hospital 10.2
indoor 10
light 10
laptop 10
dishwasher 9.9
chemist 9.8
biotechnology 9.8
looking 9.6
party 9.5
day 9.4
lifestyle 9.4
bright 9.3
patient 9.2
20s 9.2
home 8.9
interior 8.8
chemistry 8.7
smiling 8.7
clinic 8.6
smile 8.6
face 8.5
casual 8.5
commerce 8.4
communication 8.4
hand 8.4
occupation 8.2
design 7.9
liquid 7.8
photographic equipment 7.8
color 7.8
colleagues 7.8
tube 7.7
silhouette 7.5
care 7.4
student 7.2
together 7

Google
created on 2021-12-15

Photograph 94.2
Black 89.6
Gesture 85.3
Black-and-white 84.2
Style 84
Sleeve 82.9
Font 80
Monochrome photography 75.8
Event 73.3
Fashion design 72.5
Monochrome 71.7
Fun 62.3
Stock photography 61.8
Art 61.4
Rectangle 61.1
Entertainment 60.8
Room 60.8
Shorts 58.8
Child 56.9
T-shirt 53.7

Microsoft
created on 2021-12-15

text 99.4
person 96.2
footwear 95.3
clothing 95.2
man 88.7
black and white 81.4

Face analysis

Amazon

Google

AWS Rekognition

Age 44-62
Gender Male, 69.9%
Calm 85.2%
Sad 13.8%
Happy 0.6%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 45-63
Gender Male, 51.1%
Calm 45.3%
Happy 40%
Sad 6.5%
Surprised 2.2%
Confused 2.2%
Angry 2%
Fear 1.1%
Disgusted 0.7%

AWS Rekognition

Age 29-45
Gender Male, 69.4%
Calm 87.6%
Surprised 8.5%
Angry 1.3%
Sad 1.1%
Happy 0.4%
Confused 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-42
Gender Female, 70.3%
Calm 28.9%
Fear 22.8%
Happy 20.1%
Sad 11.8%
Angry 7.1%
Surprised 5.2%
Confused 3.5%
Disgusted 0.6%

AWS Rekognition

Age 37-55
Gender Male, 84.4%
Calm 53.1%
Sad 24%
Confused 13.9%
Happy 4.2%
Surprised 2.9%
Fear 1.1%
Angry 0.6%
Disgusted 0.3%

AWS Rekognition

Age 35-51
Gender Female, 50.1%
Calm 54.5%
Happy 31%
Sad 9.3%
Fear 2.1%
Confused 1.8%
Angry 0.8%
Surprised 0.4%
Disgusted 0.1%

AWS Rekognition

Age 38-56
Gender Male, 86.6%
Calm 73.8%
Happy 23.3%
Sad 1.4%
Confused 0.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 56.6%
Happy 57%
Sad 21.7%
Calm 19.2%
Confused 1.2%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Female, 66.8%
Calm 64.5%
Sad 31.1%
Surprised 1.5%
Confused 0.9%
Angry 0.8%
Happy 0.7%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 40-58
Gender Male, 90%
Calm 86.5%
Surprised 8.5%
Happy 1.9%
Sad 1.3%
Confused 0.8%
Angry 0.5%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-37
Gender Female, 57.3%
Calm 81.1%
Sad 10.1%
Happy 8.6%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 47-65
Gender Female, 67.4%
Calm 39.8%
Happy 33.3%
Sad 19.6%
Confused 3.3%
Fear 1.5%
Surprised 1.1%
Angry 1%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Female, 55.7%
Sad 52.3%
Calm 34.3%
Surprised 4.3%
Confused 3.9%
Fear 2.3%
Angry 1.2%
Disgusted 0.9%
Happy 0.8%

AWS Rekognition

Age 40-58
Gender Male, 68.1%
Calm 56.5%
Happy 25.2%
Sad 8.9%
Confused 3.6%
Angry 3.5%
Surprised 1.3%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 5-15
Gender Male, 77.8%
Calm 89.3%
Sad 6.7%
Happy 3.5%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 13-25
Gender Female, 53.3%
Calm 76%
Sad 20.2%
Happy 1.7%
Angry 1.1%
Confused 0.3%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.8%
Shoe 98.3%

Captions

Microsoft

a group of people posing for a photo 61%
a group of people posing for the camera 60.9%
a group of people posing for a picture 60.8%

Text analysis

Amazon

22434
RODVREVEEI

Google

2 2434
2434
2