Human Generated Data

Title

Untitled (two women sitting at table at cocktail party)
Date

c. 1946
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14327

Human Generated Data

Title

Untitled (two women sitting at table at cocktail party)

People

Artist: Jack Gould, American

Date

c. 1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Restaurant 99.7
Person 99.4
Human 99.4
Person 99.3
Person 99
Furniture 97.8
Chair 95.8
Person 94.3
Person 91.1
Table 90.9
Cafeteria 90.6
Dining Table 85.3
Cafe 84.8
Person 81.9
Sitting 79.7
Food 65.8
Meal 65.8
Clothing 60.3
Apparel 60.3
Helmet 58.8
Photography 57.9
Photo 57.9
Food Court 57.7
Person 50.6

Imagga
created on 2022-01-29

man 39.6
people 32.9
person 32.3
business 31
office 30.7
businessman 29.1
male 29.1
computer 28.4
laptop 25.9
meeting 24.5
working 23.9
room 22.4
table 21.9
businesswoman 20.9
adult 20.9
work 20.4
businesspeople 19.9
corporate 18.9
team 18.8
desk 18.5
indoors 18.4
indoor 18.3
executive 17.7
worker 17.7
home 17.5
happy 17.5
professional 16.8
sitting 16.3
group 16.1
colleagues 15.5
men 15.5
together 14.9
job 14.2
teamwork 13.9
shop 13.9
restaurant 13.8
smiling 13.7
chair 13.6
interior 13.3
manager 13
casual 12.7
modern 12.6
communication 12.6
salon 12.3
barbershop 12.2
technology 11.9
furniture 11.7
portrait 11.6
handsome 11.6
couple 11.3
looking 11.2
lifestyle 10.8
smile 10.7
20s 10.1
conference 9.8
human 9.7
success 9.7
30s 9.6
mercantile establishment 9.6
talking 9.5
women 9.5
house 9.2
dinner 9
employee 8.9
associates 8.8
coworkers 8.8
couch 8.7
education 8.7
day 8.6
horizontal 8.4
patient 8.3
inside 8.3
successful 8.2
confident 8.2
collaboration 7.9
teacher 7.9
businessmen 7.8
glass 7.8
clothing 7.7
partnership 7.7
expression 7.7
formal 7.6
workplace 7.6
hand 7.6
career 7.6
seat 7.6
student 7.5
fun 7.5
company 7.4
mature 7.4
wine 7.4
place of business 7.3
hairdresser 7.3

Google
created on 2022-01-29

Furniture 93.3
Chair 88.3
Coat 85.8
Style 83.8
Art 81
Vintage clothing 73.6
Suit 73.2
Font 69.9
Room 69
Monochrome photography 66.9
Sitting 66
Monochrome 65.7
Classic 65.5
Stock photography 63.9
Visual arts 63.6
History 63.2
Conversation 57.3
Illustration 56.8
Motor vehicle 56.7
Table 56.7

Microsoft
created on 2022-01-29

table 98.2
person 97.3
text 96.5
furniture 94.8
chair 91.7
clothing 91.6
man 79.4
drawing 68.5
black and white 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Male, 99.1%
Sad 95.6%
Angry 1.9%
Calm 1.3%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 98.9%
Surprised 51.9%
Fear 28.5%
Calm 11.1%
Angry 4.4%
Disgusted 1.6%
Happy 1.2%
Sad 0.8%
Confused 0.4%

AWS Rekognition

Age 18-24
Gender Female, 99.6%
Calm 95.7%
Sad 3.3%
Angry 0.5%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 29-39
Gender Female, 96.4%
Happy 53.8%
Sad 21.8%
Calm 11.1%
Confused 6.8%
Angry 2.6%
Disgusted 1.7%
Surprised 1.3%
Fear 1%

AWS Rekognition

Age 26-36
Gender Female, 62.8%
Happy 43%
Sad 22.6%
Confused 18.3%
Calm 13.8%
Angry 0.6%
Disgusted 0.6%
Fear 0.6%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.4%
Chair 95.8%
Helmet 58.8%

Captions

Microsoft

a group of people sitting at a table 78%
a group of people sitting around a table 77.9%
a group of people sitting on a table 66.4%

Text analysis

Amazon

MJIR
YT3302
MJIR YT3302 ARDA
ARDA

Google

A33A
MJ13 YT33A2 A33A
YT33A2
MJ13