Human Generated Data

Title

Untitled (studio portrait of man seated and boy standing with hand on man's shoulder)

Date

c. 1938

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4063

Human Generated Data

Title

Untitled (studio portrait of man seated and boy standing with hand on man's shoulder)

People

Artist: Durette Studio, American 20th century

Date

c. 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.9
Apparel 99.9
Furniture 97.7
Human 96.5
Person 94.4
Chair 91.3
Sleeve 90.8
Coat 90.7
Suit 90.7
Overcoat 90.7
Person 88.5
Tie 84.4
Accessory 84.4
Accessories 84.4
Footwear 80.8
Shoe 78.9
Face 78.9
Shirt 76
Long Sleeve 75
Sitting 73.3
Tie 72
People 71.5
Shorts 69.6
Female 66.5
Man 65.5
Photography 64.6
Photo 64.6
Portrait 64.6
Jacket 58.6
Blazer 58.6
Tuxedo 56.3

Clarifai
created on 2019-06-01

people 99.8
adult 97.1
man 97
two 96.1
woman 95.6
monochrome 94.3
wear 93.6
portrait 90.4
chair 89.7
group together 88.7
group 86.2
leader 85.9
actor 82.1
one 81.9
three 79.3
child 78.8
outfit 77.3
administration 76.2
actress 75.6
sit 75

Imagga
created on 2019-06-01

man 43.3
person 39.6
people 39.1
male 37.1
adult 36.2
happy 28.8
businessman 28.3
business 26.1
portrait 25.9
corporate 25.8
professional 22.8
job 20.4
office 20.1
men 18.9
couple 18.3
smiling 18.1
smile 17.8
executive 17.2
suit 17.1
mature 16.7
nurse 16.6
businesswoman 16.4
senior 15.9
women 15.8
clothing 15.4
handsome 15.2
home 14.4
businesspeople 14.2
worker 14.2
modern 14
attractive 14
alone 13.7
success 13.7
looking 13.6
life 13.5
love 13.4
groom 13.1
work 12.6
happiness 12.5
family 12.5
working 12.4
career 12.3
indoors 12.3
lifestyle 12.3
together 12.3
group 12.1
pretty 11.9
two 11.9
holding 11.6
face 11.4
standing 11.3
human 11.3
manager 11.2
old 11.2
room 11
kin 10.7
elderly 10.5
computer 10.4
meeting 10.4
building 10.3
sitting 10.3
day 10.2
casual 10.2
occupation 10.1
jacket 10
bow tie 9.9
team 9.9
black 9.6
30s 9.6
boss 9.6
formal 9.6
color 9.5
company 9.3
bright 9.3
mother 9.2
20s 9.2
successful 9.2
fashion 9.1
one 9
garment 8.8
necktie 8.8
40s 8.8
patient 8.5
teamwork 8.3
father 8.2
indoor 8.2
laptop 8.2
bride 8.2
holiday 7.9
colleagues 7.8
wife 7.6
employee 7.5
house 7.5
joy 7.5
camera 7.4
wedding 7.4
grandfather 7.3
cheerful 7.3
new 7.3
confident 7.3
aged 7.2
interior 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 97.4
person 92.1
smile 90
man 85
footwear 71.5
posing 71.1
black 70.8
human face 67.2
black and white 65.9
white 62.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 99%
Happy 25.8%
Confused 5%
Angry 2.1%
Sad 2.3%
Calm 52.1%
Surprised 7.3%
Disgusted 5.3%

AWS Rekognition

Age 26-43
Gender Male, 96.9%
Happy 6.1%
Confused 7.3%
Disgusted 1.8%
Sad 18.3%
Calm 57.6%
Angry 4.2%
Surprised 4.6%

Feature analysis

Amazon

Person 94.4%
Chair 91.3%
Tie 84.4%
Shoe 78.9%

Captions

Microsoft

a black and white photo of a person 88.9%
a man and a woman posing for a photo 73.3%
a man and woman posing for a photo 66.7%

Text analysis

Amazon

YT33A2