Human Generated Data

Title

Untitled (five men at party)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20180

Human Generated Data

Title

Untitled (five men at party)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.6
Apparel 99.6
Human 99.1
Person 99.1
Person 98.5
Person 98.3
Person 97.8
Coat 92.4
Suit 92.4
Overcoat 92.4
Tie 91.7
Accessories 91.7
Accessory 91.7
Person 90.3
Suit 87.6
Person 86.6
Sleeve 80.7
Shirt 79.7
Long Sleeve 67.5
Person 63.2
Finger 60.9
Tuxedo 59.7
People 59.5
Shorts 58.5

Imagga
created on 2022-03-05

man 50.4
male 46.8
businessman 46.8
business 46.2
team 45.7
professional 41.9
executive 39.8
meeting 39.6
office 38.1
teamwork 38
corporate 37.8
people 37.4
person 35
adult 32.5
businesspeople 31.3
happy 30.1
colleagues 29.2
businesswoman 29.1
men 27.5
work 26.7
group 25.8
job 25.7
success 25
worker 23.6
working 23
successful 22
suit 21.7
doctor 21.6
smiling 21
teacher 19.7
occupation 19.3
patient 19.2
building 18.4
standing 18.3
career 18
medical 17.7
portrait 17.5
smile 17.1
hospital 16.8
coworkers 16.7
handshake 16.6
partnership 16.3
lifestyle 15.9
indoors 15.8
mature 15.8
nurse 15.8
associates 15.7
discussion 15.6
20s 15.6
attractive 15.4
handsome 15.2
women 15
manager 14.9
40s 14.6
diversity 14.4
modern 14
confident 13.7
staff 13.6
mid adult 13.5
ethnic 13.3
medicine 13.2
hands 13
company 13
discussing 12.8
businessmen 12.7
communication 12.6
partner 12.6
30s 12.5
boss 12.4
table 12.1
health 11.8
corporation 11.6
educator 11.5
talking 11.4
senior 11.3
life 11.2
looking 11.2
stethoscope 11
casual 11
friendly 11
clinic 10.9
black 10.8
diverse 10.8
conference 10.8
care 10.7
workers 10.7
coat 10.6
employee 10.4
presentation 10.2
finance 10.1
business people 9.9
shaking 9.9
surgeon 9.9
room 9.8
shake 9.8
cheerful 9.8
employment 9.7
workplace 9.5
desk 9.5
inside 9.2
indoor 9.1
clothing 8.8
practitioner 8.8
thirties 8.8
agreement 8.7
cooperation 8.7
four 8.6
confidence 8.6
adults 8.5
two 8.5
color 8.3
human 8.3
laptop 8.2
business meeting 7.9
boardroom 7.9
together 7.9
bright 7.9
forties 7.9
happiness 7.8
colleague 7.8
deal 7.8
leadership 7.7
lab coat 7.7
exam 7.7
elderly 7.7
hand 7.6
tie 7.6
pretty 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.4
clothing 98
man 97.3
standing 96.5
text 94.7
suit 88.6
smile 55.9
black and white 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Male, 95.6%
Happy 89%
Calm 5.2%
Sad 2.5%
Surprised 1.1%
Disgusted 0.7%
Angry 0.7%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Confused 44.9%
Sad 41.3%
Disgusted 3.5%
Happy 3%
Calm 2.5%
Fear 2.5%
Angry 1.4%
Surprised 0.9%

AWS Rekognition

Age 21-29
Gender Female, 86%
Calm 97.8%
Happy 0.7%
Sad 0.5%
Surprised 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 98.4%
Calm 100%
Sad 0%
Happy 0%
Disgusted 0%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Female, 73.3%
Happy 88.5%
Calm 6.2%
Surprised 2.2%
Confused 1.2%
Sad 1.1%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 92.4%
Tie 91.7%

Captions

Microsoft

a group of people standing next to a window 96.9%
a group of people standing in front of a window 96.1%
a group of men standing next to a window 95.5%

Text analysis

Amazon

SEA

Google

YT37A2- AGO
YT37A2-
AGO