Human Generated Data

Title

Untitled (full length portrait of two unidentified boys wearing knee pants and dark stockings)
Date

1882-1891
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4035

Human Generated Data

Title

Untitled (full length portrait of two unidentified boys wearing knee pants and dark stockings)

People

Artist: Pach Brothers, American 1867-1947

Date

1882-1891

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Apparel 99.9
Clothing 99.9
Person 99
Human 99
Suit 98.8
Overcoat 98.8
Person 94.4
Standing 90.3
Coat 86.3
Jacket 86
Blazer 86
Man 83.6
Photo 62.9
Face 62.9
Photography 62.9
Portrait 62.9
Door 59.3
Shoe 57.7
Footwear 57.7
Sleeve 57.7
Pants 56.7
Shorts 55.4

Clarifai
created on 2019-11-10

people 98.4
man 95.7
wear 95.2
one 94.5
adult 94.3
retro 92.8
portrait 90.2
woman 83.6
music 81.7
sign 81.7
business 80.7
two 80.1
administration 80
facial expression 78.5
leader 76.6
movie 75
outfit 74.6
actor 73.3
musician 72.4
bill 72.1

Imagga
created on 2019-11-10

person 43.1
bow tie 36.7
suit 35.5
adult 33.8
people 33.5
necktie 30.8
man 30.7
attractive 28
male 27.9
garment 26.8
clothing 26.5
portrait 25.9
model 24.9
happy 23.2
standing 22.6
human 22.5
smile 21.4
adolescent 20.6
fashion 20.4
one 20.2
handsome 19.6
smiling 19.5
lady 19.5
cute 19.4
looking 19.2
studio 18.2
business 18.2
juvenile 17
posing 16.9
happiness 16.5
holding 15.7
jacket 15.6
pretty 15.4
sexy 15.3
couple 14.8
casual 14.4
face 14.2
love 14.2
expression 13.7
guy 13.6
businessman 13.2
lifestyle 13
elegant 12.9
youth 12.8
hair 12.7
women 12.7
style 12.6
body 12
dress 11.8
black 11.4
hand 11.4
brunette 11.3
success 11.3
professional 11.2
positive 11.1
family 10.7
executive 10.6
modern 10.5
look 10.5
tie 10.4
hands 10.4
20s 10.1
pose 10
vertical 9.6
home 9.6
boss 9.6
successful 9.2
alone 9.1
confident 9.1
leg 9
job 8.9
mother 8.8
together 8.8
formal 8.6
men 8.6
boy 8.5
charming 8.5
relaxed 8.5
joy 8.4
child 8.2
indoor 8.2
make 8.2
student 8.2
cheerful 8.1
lovely 8
indoors 7.9
bright 7.9
work 7.9
sitting 7.7
smart 7.5
blond 7.3
friendly 7.3
office 7.2
color 7.2
worker 7.1

Google
created on 2019-11-10

Photograph 96.5
Gentleman 88
Standing 87
Snapshot 84.3
Photography 74.8
Stock photography 64
Suit 62.3
Gesture 60.7
Vintage clothing 60
Formal wear 57.1
Family 56.1
Retro style 53.4
Style 51

Microsoft
created on 2019-11-10

text 99.2
clothing 99
person 97.1
man 97
posing 95
suit 94.2
standing 90.7
human face 86.8
old 83
coat 76.1
sign 61.3
white 60.4
gentleman 58.7
smile 52.3
picture frame 7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Male, 99.1%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%
Happy 0.1%
Disgusted 0%
Sad 0%
Calm 99.8%

AWS Rekognition

Age 15-27
Gender Male, 84.1%
Happy 0%
Fear 0%
Surprised 0%
Sad 0.3%
Calm 95.7%
Angry 3.8%
Disgusted 0%
Confused 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Coat 86.3%
Shoe 57.7%

Captions

Microsoft

a man standing in front of a sign posing for the camera 80.4%
a vintage photo of a man standing in front of a sign 78.7%
a man holding a sign posing for the camera 73.8%

Text analysis

Amazon

CAMBRIDGE,MASS.
ros
hich ros
hich

Google

MASS.
ruch
Bros
ruch Bros CAMBRIDGE, MASS.
CAMBRIDGE,