Human Generated Data

Title

Untitled (family portrait on window seat)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17869

Human Generated Data

Title

Untitled (family portrait on window seat)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17869

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.7
Apparel 99.7
Person 98.9
Human 98.9
Person 98.6
Person 98.2
Person 97.5
Person 97.5
Dress 95
Chair 94.7
Furniture 94.7
Home Decor 88.6
Female 85.4
Stage 80.2
Leisure Activities 78
People 71.8
Dance Pose 71.7
Table 66.7
Woman 66.5
Portrait 64.5
Photography 64.5
Photo 64.5
Face 64.5
Coat 63.3
Girl 62.7
Indoors 62.4
Suit 62.1
Overcoat 62.1
Fashion 61.8
Curtain 60
Door 56.1

Clarifai
created on 2023-10-29

people 100
group 99.1
adult 98.5
woman 98.4
group together 98.1
man 97.8
chair 95.8
leader 93.3
administration 91.7
three 91.3
four 89.9
actor 89.8
child 89.6
room 89.3
furniture 88.8
dancer 87.8
wear 87.5
actress 86.2
dancing 86
several 84.2

Imagga
created on 2022-02-26

groom 76
man 40.3
adult 35
people 34.6
sitting 33.5
male 31.9
women 30.1
couple 28.7
meeting 27.3
business 26.7
businessman 26.5
happy 25.7
lifestyle 25.3
men 24
person 23.8
office 23.6
happiness 23.5
together 22.8
smiling 21.7
team 21.5
smile 21.4
businesswoman 20.9
corporate 20.6
two 20.3
group 20.2
laptop 20
table 19.9
teamwork 19.5
indoors 19.3
executive 19.3
work 18.5
love 17.4
businesspeople 17.1
computer 16.9
suit 16.3
bride 16.3
worker 16.2
talking 16.2
communication 16
modern 15.4
working 15
wedding 14.7
pretty 14.7
indoor 14.6
colleagues 14.6
room 14.5
home 14.4
togetherness 14.2
professional 14
manager 14
sofa 13.5
family 13.3
attractive 13.3
holding 13.2
cheerful 13
success 12.9
dress 12.6
looking 12
two people 11.7
portrait 11.6
formal 11.5
face 11.4
color 11.1
casual 11
casual clothing 10.8
job 10.6
mid adult 10.6
company 10.2
day 10.2
relaxation 10.1
20 24 years 9.8
leisure activity 9.8
handsome 9.8
interior 9.7
workplace 9.5
ethnic 9.5
marriage 9.5
enjoyment 9.4
life 9.3
successful 9.2
husband 8.9
new 8.9
building 8.8
celebration 8.8
full length 8.7
couch 8.7
partnership 8.6
married 8.6
boss 8.6
loving 8.6
luxury 8.6
wife 8.5
desk 8.5
house 8.4
human 8.2
kin 8.2
employee 8
chair 7.9
food drink 7.9
living room 7.8
conference 7.8
discussion 7.8
staff 7.7
content 7.7
corporation 7.7
busy 7.7
planning 7.7
window 7.6
hand 7.6
waiter 7.6
bouquet 7.5
senior 7.5
fun 7.5
mature 7.4
care 7.4
confident 7.3
romantic 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 92.4
wedding dress 83
dress 79.3
dance 74.5
clothing 71.7
person 62.4
woman 56.8
bride 55.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 52.8%
Happy 75.6%
Surprised 17.3%
Calm 3.3%
Confused 1.8%
Disgusted 1.4%
Sad 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 47-53
Gender Male, 89.7%
Happy 93%
Sad 3.6%
Angry 1.8%
Surprised 0.6%
Confused 0.3%
Disgusted 0.2%
Calm 0.2%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Male, 96%
Happy 92.7%
Surprised 4.3%
Sad 1.7%
Disgusted 0.5%
Confused 0.2%
Calm 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Female, 55.7%
Happy 72%
Calm 24.7%
Surprised 2.2%
Sad 0.3%
Fear 0.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 92%
Happy 96.7%
Calm 0.9%
Fear 0.7%
Surprised 0.6%
Sad 0.5%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.9%
Person 98.6%
Person 98.2%
Person 97.5%
Person 97.5%

Captions

Text analysis

Amazon

3