Human Generated Data

Title

Untitled (family portrait in front of large windows)
Date

1965
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16745

Human Generated Data

Title

Untitled (family portrait in front of large windows)

People

Artist: Lucian and Mary Brown, American

Date

1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16745

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.6
Human 99.6
Clothing 99.2
Apparel 99.2
Person 99.1
Person 98.5
Person 98.2
Person 98.1
Person 96.8
People 94.7
Family 84.5
Face 77.9
Suit 77.8
Coat 77.8
Overcoat 77.8
Floor 73.5
Shirt 67.7
Door 64.7
Portrait 64.2
Photography 64.2
Photo 64.2
Couch 63.6
Furniture 63.6
Tie 63.5
Accessories 63.5
Accessory 63.5
Tie 63.3
Person 60.6
Long Sleeve 58.9
Sleeve 58.9
Dress 56

Clarifai
created on 2023-10-28

people 99.9
group 99.6
group together 98.9
man 98.8
woman 97.5
adult 96.8
three 95.2
several 94.7
wedding 93.8
leader 93.2
four 93.2
education 90.1
monochrome 89.7
child 86.5
actor 86.3
portrait 86
five 85.1
recreation 84.8
interaction 79.5
two 79.1

Imagga
created on 2022-02-26

lab coat 55.3
groom 55
coat 46.5
man 37.7
people 32.9
couple 32.3
male 31.3
person 27.9
happy 27
adult 26.2
garment 22.3
smiling 21.7
dress 21.7
happiness 21.2
love 20.5
bride 20.3
waiter 20
women 19.8
wedding 19.3
worker 19.3
smile 19.3
married 19.2
nurse 18.9
clothing 18.3
men 17.2
two 17
medical 16.8
professional 16.8
patient 16.3
portrait 15.5
dining-room attendant 15.3
business 15.2
kin 15.1
doctor 15
businessman 15
together 14.9
employee 14.9
office 14.5
suit 14.4
job 14.2
day 14.1
corporate 13.8
sitting 13.7
outdoors 13.4
family 13.4
marriage 13.3
attractive 13.3
health 13.2
cheerful 13
group 12.9
face 12.8
romantic 12.5
lifestyle 12.3
senior 12.2
hospital 12
businesswoman 11.8
team 11.7
businesspeople 11.4
celebration 11.2
teamwork 11.1
work 11
bright 10.7
mid adult 10.6
indoors 10.5
ethnic 10.5
wife 10.4
looking 10.4
bouquet 10.4
meeting 10.4
manager 10.2
romance 9.8
kiss 9.8
new 9.7
husband 9.7
standing 9.6
hands 9.6
room 9.1
pretty 9.1
holding 9.1
black 9
color 8.9
veil 8.8
medicine 8.8
gown 8.8
home 8.8
colleagues 8.7
ceremony 8.7
building 8.7
profession 8.6
talking 8.6
old 8.4
traditional 8.3
fashion 8.3
care 8.2
to 8
life 7.9
scientist 7.8
education 7.8
lab 7.8
chemistry 7.7
laboratory 7.7
modern 7.7
30s 7.7
loving 7.6
casual 7.6
relationship 7.5
father 7.5
company 7.4
executive 7.4
mother 7.4
treatment 7.4
occupation 7.3
successful 7.3

Google
created on 2022-02-26

Coat 87
Black-and-white 85.7
Style 83.9
Suit 82.1
Monochrome 78.1
Monochrome photography 75.9
Chair 74.4
Room 71.5
Vintage clothing 71.4
Event 67.2
Tree 67.2
Hat 66.1
Stock photography 63.5
History 60.9
Art 60.1
Team 59.6
Sitting 56.9
Photographic paper 55.6
Crew 51
Window 50.6

Microsoft
created on 2022-02-26

text 97.6
outdoor 89.3
person 87.1
clothing 79.7
smile 79.3
wedding 55.5
man 53.6
posing 42.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 54.4%
Happy 97%
Surprised 2.2%
Calm 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 97.7%
Happy 0.7%
Sad 0.4%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 62.5%
Happy 43.6%
Calm 23.2%
Sad 14.4%
Disgusted 8.7%
Confused 4.7%
Fear 2.5%
Angry 1.6%
Surprised 1.2%

AWS Rekognition

Age 23-31
Gender Male, 97.3%
Calm 71.4%
Happy 19.4%
Surprised 5.8%
Fear 1.1%
Sad 1%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 29-39
Gender Female, 60.3%
Calm 69.4%
Happy 14.4%
Confused 6.8%
Sad 4.7%
Disgusted 1.6%
Fear 1.4%
Surprised 1.3%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.6%
Person 99.1%
Person 98.5%
Person 98.2%
Person 98.1%
Person 96.8%
Person 60.6%
Tie 63.5%
Tie 63.3%

Categories

Imagga

people portraits 95.3%
paintings art 3.5%

Text analysis

Amazon

8
3

Google

MJI7--YT 2--A GO
MJI7--YT
2--A
GO