Human Generated Data

Title

Untitled (five men eating at small table)

Date

1949

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20263

Human Generated Data

Title

Untitled (five men eating at small table)

People

Artist: Peter James Studio, American

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.4
Human 99.4
Person 98.9
Person 97.9
Meal 97.5
Food 97.5
Furniture 95.9
Sitting 95.9
Restaurant 95
Person 94.1
Table 93.2
Dining Table 92.1
Chair 89.1
Dish 87.6
Cafeteria 82.8
People 73.8
Home Decor 72.2
Chair 71.2
Shoe 66.3
Clothing 66.3
Footwear 66.3
Apparel 66.3
Senior Citizen 65.9
Tie 65.7
Accessory 65.7
Accessories 65.7
Suit 60.1
Coat 60.1
Overcoat 60.1
Linen 56.9
Female 55

Imagga
created on 2022-03-05

brass 67.4
wind instrument 57.5
male 45.4
man 44.3
people 40.7
meeting 35.8
musical instrument 35.5
businessman 35.3
person 33.2
business 32.2
businesswoman 29.1
table 28.6
group 28.2
team 26.9
businesspeople 26.6
men 25.8
together 25.4
senior 25.3
trombone 24.6
cornet 23.6
couple 23.5
executive 22.4
teamwork 22.3
room 22
office 21.8
adult 21.5
sitting 21.5
happy 21.3
worker 20.7
women 19.8
work 19.6
home 19.1
colleagues 18.5
sax 18.1
corporate 18
mature 17.7
indoors 17.6
smiling 17.4
discussion 16.5
professional 16.4
working 15.9
elderly 15.3
talking 15.2
teacher 15.1
conference 13.7
smile 13.5
communication 13.4
desk 13.2
company 13
laptop 12.8
job 12.4
lifestyle 12.3
cheerful 12.2
manager 12.1
discussing 11.8
nurse 11.5
restaurant 11.4
friends 11.3
successful 11
drink 10.9
40s 10.7
busy 10.6
workplace 10.5
enjoying 10.4
classroom 10.4
friendship 10.3
presentation 10.2
happiness 10.2
confident 10
four people 9.9
collaboration 9.8
modern 9.8
diverse 9.8
to 9.7
conversation 9.7
portrait 9.7
30s 9.6
computer 9.6
four 9.6
drinking 9.6
employee 9.5
education 9.5
student 9.3
camera 9.2
wine 9.2
indoor 9.1
device 9.1
care 9
suit 9
new 8.9
success 8.9
seminar 8.8
60s 8.8
teaching 8.8
partners 8.7
older 8.7
cooperation 8.7
diversity 8.6
retirement 8.6
ethnic 8.6
career 8.5
plan 8.5
two 8.5
20s 8.2
meal 8.2
handsome 8
looking 8
medical 7.9
explaining 7.9
associates 7.9
coworkers 7.9
day 7.8
casual clothing 7.8
standing 7.8
retired 7.8
collar 7.7
casual 7.6
hand 7.6
document 7.5
learning 7.5
study 7.5
help 7.4
holding 7.4
alcohol 7.4
patient 7.3
horn 7.2
board 7.2
waiter 7.2
family 7.1
interior 7.1
paper 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

table 99.3
person 98
text 95
man 93.1
clothing 91
furniture 90
chair 87.3

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Disgusted 38.4%
Confused 31.3%
Sad 12.4%
Happy 6.3%
Calm 5.9%
Angry 2.8%
Surprised 2.2%
Fear 0.7%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 73.5%
Sad 11.8%
Confused 9.9%
Fear 2.1%
Surprised 1.4%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 47-53
Gender Female, 64.4%
Calm 93.6%
Sad 5.8%
Surprised 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Sad 91.9%
Calm 3.9%
Happy 2.8%
Confused 0.7%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 89.1%
Shoe 66.3%
Tie 65.7%
Suit 60.1%

Captions

Microsoft

a group of people sitting at a table 88.1%
a group of people sitting at a table with a racket 62.2%
a group of people sitting around a table 62.1%