Human Generated Data

Title

Untitled (two men sitting with beer at wooden banquet table in brewing company)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9196

Human Generated Data

Title

Untitled (two men sitting with beer at wooden banquet table in brewing company)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99
Person 99
Person 98.9
Person 98.9
Alcohol 94.5
Drink 94.5
Beverage 94.5
Person 91.7
Bottle 91.2
Beer 89.9
Apparel 77.5
Clothing 77.5
Glass 61.4
Liquor 60
Sake 59.3
Overcoat 57.5
Coat 57.5
Suit 57.5
Finger 56.3
Person 55.4

Imagga
created on 2022-01-23

man 47.7
male 38.3
business 35.2
businessman 34.4
people 31.8
person 31.6
office 28.5
professional 28
newspaper 26.3
job 23.9
working 23.9
meeting 23.5
businesswoman 22.7
corporate 22.3
worker 21.8
work 21.2
men 20.6
product 20.1
group 20.1
happy 20
executive 18.8
teamwork 18.5
team 17.9
adult 17.5
desk 17
creation 16.6
smiling 16.6
colleagues 15.5
room 15.4
businesspeople 15.2
successful 14.6
manager 14
laptop 13.9
smile 13.5
suit 13.5
talking 13.3
table 13
lifestyle 13
computer 12.9
success 12.9
black 12.6
portrait 12.3
education 12.1
scholar 11.3
sitting 11.2
building 11
communication 10.9
conference 10.7
medical 10.6
indoors 10.5
couple 10.4
women 10.3
school 10.2
finance 10.1
occupation 10.1
holding 9.9
coworkers 9.8
cooperation 9.7
30s 9.6
boss 9.6
ethnic 9.5
career 9.5
employee 9.4
student 9.4
patient 9.4
casual 9.3
company 9.3
20s 9.2
hospital 9.2
engineer 9.1
indoor 9.1
intellectual 9
handsome 8.9
color 8.9
explaining 8.9
to 8.8
discussing 8.8
classroom 8.8
diverse 8.8
discussion 8.8
architect 8.7
profession 8.6
teacher 8.6
workplace 8.6
nurse 8.5
horizontal 8.4
mature 8.4
camera 8.3
confident 8.2
new 8.1
hall 8.1
interior 8
together 7.9
paper 7.8
standing 7.8
mid adult 7.7
project 7.7
diversity 7.7
collar 7.7
senior 7.5
coffee 7.4
back 7.3
cheerful 7.3
staff 7.2
home 7.2
clinic 7.1
equipment 7.1
cricket bat 7.1
modern 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

bottle 98.7
text 98.4
soft drink 90.5
outdoor 86.8
man 84.3
clothing 83.7
person 82.5
drink 81.8
black and white 80.8
human face 64.8

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 71.8%
Calm 57%
Surprised 29.7%
Happy 5.7%
Angry 3.1%
Disgusted 1.5%
Confused 1.5%
Sad 1.3%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 98.5%
Calm 93.6%
Sad 2.1%
Surprised 1.5%
Angry 0.6%
Disgusted 0.6%
Confused 0.6%
Happy 0.5%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Beer 89.9%

Captions

Microsoft

a man standing next to a window 60.4%
a man standing in front of a window 60.3%
a group of men standing next to a window 55.1%

Text analysis

Amazon

Alpen
Brau
KODAK-
٢٢٥

Google

6rau
Alpen 6rau
Alpen