Human Generated Data

Title

Untitled (six men posed at table displaying beer bottles and cigars and banquet room filled with tables and people)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9194

Human Generated Data

Title

Untitled (six men posed at table displaying beer bottles and cigars and banquet room filled with tables and people)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.3
Person 99.1
Person 99.1
Person 98.8
Person 97.9
Person 96.3
Person 95.9
Helmet 90.1
Clothing 90.1
Apparel 90.1
Clinic 89.1
Person 85.1
Bottle 84.5
Beverage 82.4
Drink 82.4
Tie 79.8
Accessories 79.8
Accessory 79.8
Bar Counter 73.9
Pub 73.9
Person 73
Alcohol 71.4
Sunglasses 65.2
Sunglasses 64.4
Room 62.6
Indoors 62.6
Operating Theatre 59.2
Hospital 59.2
Glass 57.3
Person 52.3

Imagga
created on 2022-01-23

patient 57.6
person 55.2
man 42.3
case 41.3
sick person 40.1
nurse 34.9
male 34
people 34
adult 25.4
business 24.9
businessman 24.7
marimba 22.7
indoors 21.1
room 20.8
percussion instrument 20.4
computer 20.1
meeting 19.8
sitting 19.8
professional 19.7
smiling 19.5
office 19.5
working 19.4
group 19.3
desk 18.9
work 18.8
worker 18.7
education 18.2
table 18.2
happy 18.2
businesspeople 18
teacher 18
musical instrument 17.6
classroom 16.3
men 16.3
colleagues 15.5
businesswoman 15.4
color 14.5
lifestyle 14.5
team 14.3
teamwork 13.9
cheerful 13.8
occupation 13.7
communication 13.4
medical 13.2
lab coat 12.9
day 12.6
hospital 12.4
interior 12.4
together 12.3
home 12
indoor 11.9
happiness 11.8
horizontal 11.7
40s 11.7
mid adult 11.6
coat 11.6
job 11.5
corporate 11.2
women 11.1
casual 11
class 10.6
30s 10.6
talking 10.5
doctor 10.3
keyboard 10.3
laptop 10.3
executive 10.2
student 10
board 9.9
hand 9.9
specialist 9.8
conference 9.8
monitor 9.8
looking 9.6
couple 9.6
adults 9.5
senior 9.4
clothing 9.1
suit 9
handsome 8.9
restaurant 8.9
coworkers 8.8
discussion 8.8
chair 8.7
smile 8.6
enjoyment 8.4
study 8.4
health 8.3
holding 8.3
20s 8.2
educator 7.8
two people 7.8
portrait 7.8
modern 7.7
angle 7.7
four 7.7
workplace 7.6
college 7.6
screen 7.5
technology 7.4
care 7.4
focus 7.4
camera 7.4
successful 7.3
friendly 7.3
confident 7.3
employee 7.3
medicine 7

Google
created on 2022-01-23

Black 89.8
Hat 76
Monochrome 75.1
Monochrome photography 75
Snapshot 74.3
Laboratory equipment 70.2
Personal protective equipment 67.4
Event 67.3
Recreation 66.8
Service 66.3
Stock photography 65.5
Science 63.1
Cooking 62.7
Room 62
Vintage clothing 61.7
Uniform 58.5
Indoor games and sports 57
History 55.1
Font 55.1
Machine 54.6

Microsoft
created on 2022-01-23

person 99.8
bottle 93.5
man 90.2
text 85.9
clothing 70.4

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.1%
Calm 96.2%
Sad 2%
Happy 0.7%
Confused 0.3%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 97.9%
Calm 49.8%
Sad 20.4%
Surprised 16.9%
Confused 5.2%
Disgusted 3.9%
Happy 2.6%
Angry 0.9%
Fear 0.4%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Confused 54.2%
Sad 13.7%
Happy 10.2%
Calm 9.5%
Surprised 5.2%
Angry 4.3%
Disgusted 2.5%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Male, 94.7%
Calm 99.1%
Happy 0.4%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 75.6%
Confused 16.8%
Surprised 2.6%
Happy 2.5%
Sad 1.4%
Disgusted 0.9%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 23-33
Gender Female, 78.2%
Sad 50.2%
Calm 35.2%
Confused 4.7%
Disgusted 4.6%
Angry 1.7%
Happy 1.7%
Surprised 1.1%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 94.1%
Calm 92.8%
Fear 2.4%
Sad 1.4%
Angry 1.1%
Disgusted 0.9%
Happy 0.8%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Female, 50%
Calm 52.8%
Sad 37.6%
Surprised 1.8%
Confused 1.8%
Happy 1.7%
Fear 1.5%
Angry 1.4%
Disgusted 1.4%

AWS Rekognition

Age 19-27
Gender Male, 77.8%
Sad 78%
Happy 8.5%
Calm 7.2%
Confused 3.1%
Fear 1.1%
Surprised 0.7%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-26
Gender Male, 95.3%
Happy 60.6%
Calm 21.4%
Fear 5.7%
Angry 5.1%
Sad 4%
Surprised 1.4%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 27-37
Gender Male, 78.2%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 56.6%
Sad 63.3%
Calm 17.6%
Happy 5.5%
Angry 3.9%
Confused 3.9%
Surprised 2.2%
Disgusted 2.2%
Fear 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.5%
Helmet 90.1%
Tie 79.8%
Sunglasses 65.2%

Captions

Microsoft

a group of people standing in front of a window 75.3%
a man holding a wine glass 41.6%
a group of people in front of a window 41.5%

Text analysis

Amazon

PHILLIES
Alpen
pen
Alpe
en
CIGA
ИТ ВА Alpen
Bras
Ipen
Grau
did
13551
PER
ИТ ВА
Alpelar
up
and up
and

Google

PHILLIES
PHILLIES