Human Generated Data

Title

Untitled (group of people at table at party)

Date

1964

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19197

Human Generated Data

Title

Untitled (group of people at table at party)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1964

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19197

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.4
Human 99.4
Person 99.4
Person 99.3
Person 98.3
Person 97.6
Clothing 96.6
Apparel 96.6
Person 95.4
Person 95.1
Person 95
Person 94.4
Furniture 93.9
Tie 93.8
Accessories 93.8
Accessory 93.8
Person 93.2
Tie 90.4
Overcoat 88.1
Coat 88.1
Person 87.8
Suit 85.8
Face 83.3
Chair 76.4
Meal 75.5
Food 75.5
Chair 73.8
People 73
Shirt 73
Suit 72.6
Tuxedo 67.7
Sunglasses 67.7
Dish 66.4
Photography 64
Photo 64
Portrait 63.7
Table 62.4
Head 61.9
Waiter 58.8

Clarifai
created on 2023-10-22

people 99.9
group 99.5
adult 99.3
man 98.4
woman 98.4
group together 95
medical practitioner 94.8
five 93
musician 92.6
four 91.9
music 91.2
administration 91
leader 90.9
education 90.2
chair 89
several 89
three 88.7
sit 88.4
child 87.8
room 87.6

Imagga
created on 2022-03-05

man 45.7
person 45.1
male 41.9
teacher 40.6
professional 39.9
office 35.7
businessman 35.3
people 35.2
adult 33.2
business 32.2
meeting 31.1
room 31
smiling 28.2
sitting 27.5
educator 27.2
teamwork 26.9
team 26.9
table 26.8
men 26.6
group 25.8
talking 25.7
together 25.4
colleagues 25.3
happy 25.1
patient 25
work 24.3
executive 23.6
indoors 22.9
businesswoman 22.7
working 22.1
classroom 21.8
women 19.8
corporate 19.8
senior 19.7
job 19.5
businesspeople 19
desk 18.9
worker 18.6
home 16.8
mature 16.7
suit 16.2
nurse 16.1
computer 16
education 15.6
communication 15.1
student 15.1
couple 14.8
coworkers 14.7
40s 14.6
laptop 14.6
entrepreneur 14.5
success 13.7
portrait 13.6
smile 13.5
modern 13.3
manager 13
presentation 13
life 12.8
conference 12.7
mid adult 12.6
medical 12.4
doctor 12.2
cheerful 12.2
occupation 11.9
successful 11.9
case 11.8
discussion 11.7
hospital 11.6
30s 11.6
diversity 11.5
ethnic 11.4
chair 11.3
inside 11
sick person 11
casual 11
indoor 11
associates 10.8
diverse 10.8
class 10.6
four 10.6
elderly 10.5
standing 10.4
technology 10.4
employee 10.4
lifestyle 10.1
horizontal 10.1
discussing 9.8
businessmen 9.8
adults 9.5
color 9.5
happiness 9.4
20s 9.2
board 9
interior 8.9
hall 8.7
day 8.6
boss 8.6
practitioner 8.6
health 8.3
camera 8.3
treatment 8.3
clinic 8.2
looking 8
70s 7.9
50s 7.8
teaching 7.8
middle aged 7.8
partners 7.8
retired 7.8
looking camera 7.7
exam 7.7
illness 7.6
workplace 7.6
finance 7.6
waiter 7.6
career 7.6
learning 7.5
specialist 7.3
restaurant 7.3
new 7.3
confident 7.3
to 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 98.9
text 94.7
clothing 94
table 86.2
man 82.3
window 81.1
furniture 78.5
computer 77.2
laptop 68.9
chair 65.5
woman 61.5
group 57.9
posing 41.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Happy 40.8%
Surprised 23.1%
Sad 16.8%
Confused 8.5%
Calm 4.9%
Angry 2.6%
Disgusted 2.4%
Fear 0.8%

AWS Rekognition

Age 48-54
Gender Male, 100%
Sad 60.5%
Disgusted 11.9%
Calm 9.2%
Angry 5%
Confused 4.6%
Fear 4.2%
Happy 3%
Surprised 1.6%

AWS Rekognition

Age 37-45
Gender Female, 92.9%
Happy 82.6%
Surprised 10.9%
Confused 2.2%
Calm 1.7%
Disgusted 1.2%
Sad 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Calm 36.2%
Surprised 22.4%
Confused 19.3%
Sad 15.4%
Happy 3.5%
Disgusted 1.6%
Angry 1.2%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Sad 78%
Happy 15.1%
Confused 5.6%
Disgusted 0.6%
Calm 0.5%
Surprised 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 50-58
Gender Male, 90.9%
Calm 95%
Sad 3.1%
Happy 1%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 93.1%
Sad 4.4%
Confused 1%
Surprised 0.5%
Fear 0.4%
Disgusted 0.3%
Angry 0.2%
Calm 0.1%

AWS Rekognition

Age 42-50
Gender Male, 59.3%
Calm 98.3%
Sad 0.6%
Happy 0.4%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 45-53
Gender Female, 59.8%
Calm 97.8%
Sad 0.7%
Happy 0.6%
Confused 0.5%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Confused 63.4%
Happy 21.2%
Surprised 5.3%
Sad 4%
Disgusted 2.5%
Calm 1.5%
Fear 1.1%
Angry 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Chair
Sunglasses
Person 99.4%
Person 99.4%
Person 99.3%
Person 98.3%
Person 97.6%
Person 95.4%
Person 95.1%
Person 95%
Person 94.4%
Person 93.2%
Person 87.8%
Tie 93.8%
Tie 90.4%
Suit 85.8%
Suit 72.6%
Chair 76.4%
Chair 73.8%
Sunglasses 67.7%

Text analysis

Amazon

4
с
g
MAGOM
MJIA
MJI7
MAQOX
MJI7 YT37A2 MAQOX
YT37A2
tv

Google

MAGOA MJIR YT37 A2 XAGOX MJI3 YT33 A2
MAGOA
MJIR
YT37
A2
XAGOX
MJI3
YT33