Human Generated Data

Title

Untitled (four men sitting with beer bottles at banquet in brewing company)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9198

Human Generated Data

Title

Untitled (four men sitting with beer bottles at banquet in brewing company)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Person 99.3
Person 98.8
Person 96.3
Accessories 91.1
Accessory 91.1
Sunglasses 91.1
Pub 86.9
Clothing 85.5
Apparel 85.5
Drink 84.1
Beer 84.1
Beverage 84.1
Alcohol 84.1
Bar Counter 79.4
Food 76.1
Meal 76.1
Sunglasses 75.9
Sitting 72.4
Worker 70
Restaurant 69.7
Shirt 67.8
Tie 66.7
Scientist 58.8

Imagga
created on 2022-01-23

engineer 50.5
man 47.7
male 31.9
lab coat 30.1
people 30.1
work 29.8
working 29.1
coat 27.5
person 26.9
professional 26.6
office 25.2
business 23.7
medical 22.9
indoors 21.1
computer 21
adult 20.9
men 20.6
worker 19.1
job 18.6
sitting 18
laptop 17
businessman 16.8
doctor 16
patient 14.8
group 14.5
team 14.3
hospital 14.3
room 13.9
smiling 13.7
scientist 13.7
building 13.3
student 12.8
lab 12.6
chemistry 12.6
laboratory 12.5
health 12.5
research 12.4
businesspeople 12.3
lifestyle 12.3
desk 12.3
meeting 12.2
education 12.1
corporate 12
occupation 11.9
20s 11.9
businesswoman 11.8
science 11.6
happy 11.3
restaurant 11.3
senior 11.2
study 11.2
mature 11.2
technology 11.1
teamwork 11.1
clinic 10.9
microscope 10.8
school 10.8
surgeon 10.7
equipment 10.6
mid adult 10.6
medicine 10.6
color 10.6
biology 10.4
table 10.4
portrait 10.3
indoor 10
teacher 10
executive 10
garment 9.8
40s 9.7
assistant 9.7
using 9.6
looking 9.6
college 9.5
industry 9.4
two 9.3
university 8.9
colleagues 8.7
couple 8.7
day 8.6
workplace 8.6
talking 8.6
casual 8.5
manager 8.4
holding 8.2
together 7.9
nurse 7.8
face 7.8
concentration 7.7
30s 7.7
exam 7.7
serious 7.6
horizontal 7.5
learning 7.5
keyboard 7.5
focus 7.4
successful 7.3
confident 7.3
success 7.2
clothing 7.2
machine 7.2
women 7.1
classroom 7.1
monitor 7.1
paper 7.1
modern 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.5
bottle 98.8
person 97
drink 88.3
table 79.2
black and white 74.3
man 69.8
soft drink 65.6
clothing 61.8

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 99.5%
Surprised 0.2%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 92.2%
Happy 3.6%
Surprised 1.8%
Sad 1.4%
Confused 0.5%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 90.9%
Happy 5.3%
Surprised 1.6%
Confused 1.2%
Disgusted 0.4%
Sad 0.4%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 99.5%
Confused 0.2%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Sunglasses 91.1%
Beer 84.1%
Tie 66.7%

Captions

Microsoft

a group of people posing for the camera 83.2%
a group of people posing for a picture 83.1%
a group of people posing for a photo 77.4%

Text analysis

Amazon

Alpen
Brau
Alpe
-
13351
YT33XX

Google

Apen
Apen