Human Generated Data

Title

Untitled (school portrait of 42 boys in front of school)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3602

Human Generated Data

Title

Untitled (school portrait of 42 boys in front of school)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.1
Human 99.1
Person 98.4
Person 98.3
Person 94.3
Person 94.2
Person 93.9
Person 93.2
Person 92.2
Person 89.2
Person 88.7
Room 83.7
Indoors 83.7
Person 79
Crowd 77
Person 76.5
People 76.1
Clothing 72
Apparel 72
Drawing 60.4
Art 60.4
Face 55.2

Clarifai
created on 2019-06-01

technology 93.3
desktop 92.8
network 90
internet 88.3
illustration 87.1
communication 86.9
connection 85.1
future 84.8
man 84.5
computer 84.3
modern 83.4
technical school 83.1
business 83.1
people 82.9
system 82.8
virtual 81.8
World Wide Web 81.8
abstract 81.4
graphic 81.4
image 80.7

Imagga
created on 2019-06-01

negative 37.6
blackboard 31.3
film 30
photographic paper 23.2
tray 20.7
business 18.2
texture 18.1
grunge 17.9
design 17.4
art 17.3
graphic 16.8
receptacle 16.8
retro 16.4
wallpaper 16.1
pattern 15.7
photographic equipment 15.5
vintage 14.9
container 13.4
snow 12.7
old 12.5
architecture 12.5
decoration 12.4
cold 12.1
light 12
frame 11.9
star 11.7
modern 11.2
winter 11.1
finance 11
holiday 10.7
web site 10.6
sign 10.5
close 10.3
color 10
silhouette 9.9
currency 9.9
landscape 9.7
black 9.6
frozen 9.5
ripple 9.5
scene 9.5
splash 9.5
paper 9.5
symbol 9.4
motion 9.4
money 9.4
card 9.4
water 9.3
dollar 9.3
bank 9
building 8.9
backgrounds 8.9
digital 8.9
shape 8.9
ice 8.8
text 8.7
wave 8.6
season 8.6
line 8.6
house 8.5
flowing 8.4
cash 8.2
global 8.2
style 8.2
border 8.1
treasury 8.1
transparent 8.1
cool 8
drawing 8
country 7.9
urban 7.9
splashing 7.7
frost 7.7
sky 7.7
cityscape 7.6
energy 7.6
decorative 7.5
city 7.5
reflection 7.5
glass 7.5
element 7.4
backdrop 7.4
environment 7.4
structure 7.3
drop 7.2
paint 7.2
history 7.2
facility 7.1
night 7.1
world 7.1
antique 7.1
travel 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

window 91.2
person 90.7
wedding dress 89.4
clothing 85.3
old 77.3
posing 75.9
bride 75.2

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Disgusted 45.5%
Confused 45.5%
Surprised 45.3%
Calm 47.8%
Happy 45.9%
Angry 45.5%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Happy 50.9%
Disgusted 45.4%
Angry 45.4%
Surprised 45.4%
Sad 46.4%
Calm 45.9%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Male, 54%
Confused 45.3%
Surprised 45.3%
Calm 52.6%
Sad 45.7%
Happy 45.6%
Disgusted 45.2%
Angry 45.3%

AWS Rekognition

Age 20-38
Gender Female, 51.3%
Angry 45.4%
Surprised 45.3%
Calm 47.3%
Sad 50.5%
Confused 45.5%
Disgusted 45.6%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52.8%
Confused 45.4%
Surprised 45.5%
Sad 45.8%
Angry 45.4%
Happy 46.2%
Calm 51.5%
Disgusted 45.2%

AWS Rekognition

Age 23-38
Gender Female, 52.9%
Angry 45.3%
Happy 48.5%
Confused 45.1%
Sad 45.2%
Calm 49.8%
Surprised 45.5%
Disgusted 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Confused 46.4%
Happy 46.7%
Calm 48.5%
Disgusted 45.6%
Sad 46%
Angry 45.5%
Surprised 46.4%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Disgusted 47.5%
Happy 48.1%
Surprised 45.7%
Sad 45.5%
Angry 46.2%
Confused 45.5%
Calm 46.6%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Happy 45.4%
Confused 45.4%
Angry 45.5%
Sad 45.6%
Calm 52.5%
Surprised 45.4%
Disgusted 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Surprised 45.3%
Sad 50.4%
Happy 45.7%
Angry 45.5%
Disgusted 45.2%
Confused 45.4%
Calm 47.6%

AWS Rekognition

Age 26-43
Gender Female, 52%
Sad 46.3%
Surprised 45.2%
Disgusted 45.2%
Angry 45.2%
Calm 46.8%
Happy 50.9%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 45.6%
Calm 48.9%
Sad 46.6%
Surprised 45.5%
Disgusted 46.2%
Happy 46.8%
Confused 45.4%

AWS Rekognition

Age 48-68
Gender Female, 51.6%
Angry 45.6%
Happy 45.5%
Confused 45.5%
Sad 50.2%
Calm 47.2%
Surprised 45.5%
Disgusted 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45.9%
Calm 51.8%
Angry 45.5%
Surprised 45.3%
Disgusted 45.3%
Confused 45.8%
Sad 45.4%

AWS Rekognition

Age 27-44
Gender Female, 50.8%
Calm 53.6%
Disgusted 45.1%
Confused 45.2%
Surprised 45.3%
Happy 45.3%
Sad 45.3%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Female, 52.3%
Disgusted 45.3%
Calm 45.9%
Surprised 45.3%
Angry 45.3%
Happy 52.5%
Sad 45.6%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Male, 54.4%
Sad 45.3%
Angry 45.1%
Calm 52.7%
Confused 45.2%
Disgusted 45.1%
Happy 46.5%
Surprised 45.1%

AWS Rekognition

Age 35-53
Gender Female, 51.7%
Angry 45.1%
Happy 45%
Calm 45.3%
Surprised 45%
Sad 54.5%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Sad 50.9%
Surprised 45.6%
Happy 45.4%
Angry 45.2%
Calm 46.5%
Confused 46%
Disgusted 45.4%

AWS Rekognition

Age 27-44
Gender Female, 52%
Surprised 45.5%
Calm 45.7%
Disgusted 50.3%
Confused 45.3%
Sad 45.8%
Happy 45.8%
Angry 46.7%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 45.2%
Surprised 45.2%
Angry 45.2%
Calm 53.4%
Disgusted 45.1%
Sad 45.6%
Happy 45.3%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Happy 45.5%
Surprised 45.8%
Calm 47.1%
Sad 49.9%
Disgusted 45.3%
Angry 45.6%
Confused 45.6%

AWS Rekognition

Age 26-43
Gender Female, 55%
Confused 45.6%
Sad 46%
Calm 50.4%
Happy 46%
Surprised 46%
Disgusted 45.6%
Angry 45.5%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people posing for a photo 82.3%
a group of people posing for a photo in front of a window 72.3%
an old photo of a group of people posing for the camera 72.2%

Text analysis

Amazon

ABDUma