Human Generated Data

Title

Untitled (family sitting at table with box of ornaments)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16389

Human Generated Data

Title

Untitled (family sitting at table with box of ornaments)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 98.4
Person 98.4
Person 98
Person 97.1
Person 96.2
Person 95.6
Person 94.5
Person 93.5
Clothing 93.1
Apparel 93.1
Accessory 92.8
Tie 92.8
Accessories 92.8
Cream 87.1
Food 87.1
Creme 87.1
Dessert 87.1
Cake 87.1
Icing 87.1
Suit 82
Coat 82
Overcoat 82
Face 81.6
Indoors 80.9
Interior Design 80.9
People 80
Plant 79.2
Furniture 74.9
Room 73.9
Female 71.8
Meal 71.7
Flower 68
Blossom 68
Portrait 64.5
Photography 64.5
Photo 64.5
Dress 63.8
Flower Arrangement 60.6
Girl 59.3
Sitting 58.5
Art 58.4
Kid 58.2
Child 58.2
Drawing 58.2
Chair 57.6
Table 57.1
Baby 57
Fashion 55.6
Gown 55.6

Imagga
created on 2022-02-11

man 50.4
male 43.3
groom 42.8
people 39
office 35.2
adult 34.8
businessman 34.4
business 33.4
meeting 32
person 30.7
couple 29.6
happy 28.8
senior 28.1
smiling 27.5
laptop 27.3
team 26.9
men 25.8
executive 24.6
together 24.5
women 24.5
table 24.3
sitting 24.1
businesspeople 23.7
businesswoman 23.6
home 23.1
mature 21.4
colleagues 21.4
indoors 21.1
computer 20.8
desk 19.9
worker 19.8
work 19.6
talking 19
corporate 18.9
group 18.5
elderly 18.2
portrait 17.5
kin 17.4
professional 17.1
working 16.8
teamwork 16.7
happiness 16.5
smile 16.4
lifestyle 15.9
room 15.9
manager 15.8
looking 15.2
cheerful 14.6
discussion 14.6
older 13.6
casual 13.6
two 13.6
suit 13.5
husband 13.5
30s 13.5
horizontal 13.4
modern 13.3
indoor 12.8
coworkers 12.8
conference 12.7
40s 12.7
mid adult 12.5
old 12.5
camera 12
casual clothing 11.7
retirement 11.5
job 11.5
color 11.1
20s 11
day 11
60s 10.7
newspaper 10.7
face 10.7
spectator 10.6
leader 10.6
four 10.5
wife 10.4
technology 9.6
teacher 9.5
communication 9.2
clothing 9
grandma 8.9
handsome 8.9
boardroom 8.9
four people 8.9
associates 8.9
discussing 8.8
thirties 8.8
corporation 8.7
tie 8.5
successful 8.2
aged 8.1
new 8.1
success 8
love 7.9
collaboration 7.9
paper 7.8
standing 7.8
retired 7.8
classroom 7.8
attractive 7.7
boss 7.7
formal 7.6
enjoying 7.6
adults 7.6
product 7.6
bouquet 7.5
friends 7.5
presentation 7.4
mother 7.4
confident 7.3
employee 7.1
family 7.1
to 7.1
grandfather 7.1
life 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 99
wall 95.1
person 91.6
indoor 91.4
drawing 91.2
window 80.7
human face 72.3
sketch 62.1
clothing 51.6
old 48.8

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 86.5%
Happy 90.5%
Calm 5%
Surprised 1.7%
Sad 0.8%
Angry 0.7%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 30-40
Gender Female, 59.4%
Happy 38.9%
Calm 32.5%
Surprised 14.8%
Fear 6.8%
Angry 3.3%
Sad 2.1%
Disgusted 1.2%
Confused 0.4%

AWS Rekognition

Age 51-59
Gender Male, 91.2%
Happy 55.7%
Surprised 25.7%
Confused 9.6%
Calm 3%
Angry 2.1%
Disgusted 1.9%
Sad 1.1%
Fear 1%

AWS Rekognition

Age 10-18
Gender Female, 68%
Calm 61.6%
Sad 21.9%
Surprised 4.6%
Happy 3.2%
Disgusted 2.9%
Angry 2.8%
Fear 1.6%
Confused 1.3%

AWS Rekognition

Age 25-35
Gender Male, 61%
Calm 95.6%
Surprised 2.2%
Happy 0.7%
Sad 0.4%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 68.2%
Sad 89.6%
Happy 3%
Calm 2.6%
Surprised 1.9%
Confused 1.1%
Fear 0.8%
Disgusted 0.5%
Angry 0.5%

AWS Rekognition

Age 16-24
Gender Male, 79.8%
Happy 90.1%
Surprised 6.3%
Calm 1.4%
Angry 0.8%
Fear 0.5%
Disgusted 0.5%
Sad 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Tie 92.8%
Suit 82%

Captions

Microsoft

a group of people standing in front of a window 85.3%
a group of people in front of a window 84.8%
an old photo of a group of people standing in front of a window 79.7%

Text analysis

Amazon

14
от

Google

14
14