Human Generated Data

Title

Untitled (man standing at dinner table giving toast)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17262

Human Generated Data

Title

Untitled (man standing at dinner table giving toast)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.6
Person 99.6
Person 99.1
Person 98.9
Clothing 95.9
Apparel 95.9
Person 95.4
Person 94.7
Audience 93
Crowd 93
Room 90.6
Indoors 90.6
Tie 85.1
Accessories 85.1
Accessory 85.1
Plant 84.3
Sitting 84.2
Overcoat 82
Coat 82
Flower 79.3
Blossom 79.3
Person 75.5
Suit 68.8
Flower Arrangement 68.7
Speech 66.8
People 66.2
Suit 62.7
Flower Bouquet 59.6
Long Sleeve 55.4
Sleeve 55.4
Tuxedo 55.1

Imagga
created on 2022-02-26

man 47.7
executive 42.7
male 41.2
office 37.2
businessman 37.1
business 37.1
person 35.6
people 34.6
adult 34.4
meeting 33.9
professional 28.6
room 27.6
team 26.9
table 26.8
teacher 25.5
smiling 25.3
group 25
sitting 24.9
businesspeople 24.7
businesswoman 24.6
happy 24.5
corporate 24.1
colleagues 23.3
work 22.8
men 22.3
indoors 20.2
laptop 20.1
couple 20
director 19
women 19
desk 18.9
secretary 17.9
job 17.7
teamwork 17.6
conference 17.6
suit 17.5
smile 17.1
modern 16.8
mature 16.7
indoor 16.4
talking 16.2
communication 16
worker 16
together 15.8
portrait 15.5
speaker 15.4
computer 15.2
entrepreneur 15
presentation 14.9
educator 14.8
20s 14.7
cheerful 14.6
classroom 14.4
manager 14
casual 13.6
home 13.6
senior 13.1
education 13
looking 12.8
associates 12.8
working 12.4
lifestyle 12.3
two 11.9
discussion 11.7
color 11.1
happiness 11
confident 10.9
coworkers 10.8
handsome 10.7
interior 10.6
30s 10.6
articulator 10.2
successful 10.1
board 10
boardroom 9.9
life 9.9
mid adult 9.7
corporation 9.7
technology 9.7
staff 9.6
standing 9.6
student 9.5
tie 9.5
40s 8.8
workplace 8.6
career 8.5
horizontal 8.4
occupation 8.3
hall 8.1
to 8
face 7.8
partners 7.8
communicator 7.8
cooperation 7.7
patient 7.7
jacket 7.7
four 7.7
boss 7.7
ethnic 7.6
hand 7.6
doctor 7.5
human 7.5
company 7.4
training 7.4
wine 7.4
new 7.3
success 7.2
employee 7.1
medical 7.1
restaurant 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 98.6
text 91.6
clothing 88.9
man 87.2
human face 79
group 60.9
room 41.2

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.3%
Happy 61.8%
Sad 16.5%
Calm 12.6%
Surprised 2.7%
Confused 2.6%
Disgusted 1.6%
Angry 1.2%
Fear 1%

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Calm 98.3%
Sad 1.5%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Female, 72.7%
Calm 59.8%
Surprised 38%
Disgusted 0.6%
Sad 0.6%
Happy 0.3%
Confused 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 51-59
Gender Male, 98.9%
Calm 79.8%
Sad 15.3%
Confused 2.6%
Happy 0.7%
Angry 0.5%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 39.9%
Fear 27.5%
Confused 9.9%
Disgusted 8.2%
Angry 5.9%
Sad 3.7%
Surprised 3.5%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 85.1%
Suit 68.8%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 84.1%
a group of people standing in front of a mirror 84%
a group of people in front of a mirror posing for the camera 83.1%

Text analysis

Amazon

KODAK-SEELA

Google

YT37A2-XAGOX
YT37A2-XAGOX