Human Generated Data

Title

Untitled (large twenty-one member family portrait in front of house)
Date

c.1910
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3922

Human Generated Data

Title

Untitled (large twenty-one member family portrait in front of house)

People

Artist: Durette Studio, American 20th century

Date

c.1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 98.4
Human 98.4
Person 97.6
Person 97.2
Nature 96.9
Person 95.8
Person 95.8
Person 94.2
Person 94
Person 92.6
Person 87.7
Outdoors 87.2
Person 87.1
Person 82.1
Person 80.8
Person 78.1
People 76.7
Crowd 76.7
Face 69.4
Person 68.7
Person 68.6
Fog 67
Art 64.4
Drawing 64.4
Person 64.2
Person 63.7
Clothing 60.9
Apparel 60.9
Smoke 60
Snow 58.3
Person 55.6
Weather 55.5
Person 53.7

Clarifai
created on 2019-06-01

people 99.7
group 97
adult 95.6
group together 95
child 94.1
many 93.3
man 92.4
woman 89.5
leader 88.1
education 85.4
portrait 83.1
monochrome 81.9
retro 80
school 79.4
wear 76
boy 71.2
several 71.1
crowd 69.7
room 64.6
veil 64.4

Imagga
created on 2019-06-01

negative 56.5
film 43
photographic paper 33.2
snow 25.6
photographic equipment 22.1
grunge 19.6
winter 17.9
drawing 17.7
wallpaper 17.6
graphic 17.5
art 16.4
pattern 16.4
design 16.3
decoration 16.2
texture 16
silhouette 15.7
snowman 15.7
sketch 15.2
digital 14.6
ice 14.1
cold 13.8
light 13.4
season 13.2
creative 13.2
holiday 12.9
backdrop 12.4
color 12.2
globe 12
celebration 12
shape 11.9
figure 11.9
style 11.1
network 11.1
artwork 11
decorative 10.9
cool 10.7
snowflake 10.6
white 10.5
symbol 10.1
space 10.1
connection 10.1
science 9.8
business 9.7
new 9.7
virtual 9.7
splash 9.6
ornament 9.5
poster 9.4
water 9.3
map 9.3
weather 9.3
global 9.1
sky 8.9
technology 8.9
ball 8.8
liquid 8.7
halftone 8.5
web 8.5
communication 8.4
representation 8.4
shine 8.3
year 8.2
paint 8.1
backgrounds 8.1
star 8.1
artistic 7.8
people 7.8
card 7.8
modern 7.7
ink 7.7
frozen 7.6
rain 7.5
retro 7.4
earth 7.3
drop 7.3
world 7.3
dirty 7.2
black 7.2
futuristic 7.2
graphics 7.1
person 7.1
net 7.1
decor 7.1

Google
created on 2019-06-01

White 97.2
Photograph 96.9
Snapshot 86.3
Black-and-white 82.7
Photography 77.5
Monochrome 74.2
Stock photography 68.5
Room 65.7
Monochrome photography 57.8
Style 52.5
Art 50.2

Microsoft
created on 2019-06-01

fog 85.3
person 85
clothing 84.6
posing 63.4
old 57.7
human face 57.2

Face analysis

Amazon

AWS Rekognition

Age 19-36
Gender Female, 53.5%
Sad 46.8%
Happy 45.4%
Surprised 45.4%
Calm 51.4%
Disgusted 45.2%
Confused 45.4%
Angry 45.4%

AWS Rekognition

Age 45-63
Gender Female, 54.8%
Disgusted 45.1%
Sad 50.6%
Surprised 45.3%
Happy 45.1%
Angry 45.2%
Calm 48.3%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Female, 55%
Happy 45.5%
Confused 45.4%
Disgusted 45.2%
Sad 52.3%
Calm 46.2%
Angry 45.2%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Angry 45.5%
Confused 45.4%
Surprised 45.3%
Happy 46.6%
Sad 47.2%
Calm 49.9%
Disgusted 45.2%

AWS Rekognition

Age 14-25
Gender Female, 52.7%
Confused 45.9%
Disgusted 45.1%
Calm 47.7%
Angry 46%
Sad 49.5%
Happy 45.1%
Surprised 45.8%

AWS Rekognition

Age 29-45
Gender Female, 54.9%
Surprised 45.9%
Calm 51%
Disgusted 45.3%
Confused 45.4%
Sad 46.1%
Happy 46.1%
Angry 45.2%

AWS Rekognition

Age 29-45
Gender Female, 54.5%
Disgusted 45.2%
Calm 46.2%
Angry 45.1%
Sad 52.4%
Surprised 45.5%
Happy 45.2%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Confused 45.8%
Calm 46.5%
Sad 47%
Surprised 46.3%
Angry 46.4%
Disgusted 46.3%
Happy 46.6%

AWS Rekognition

Age 23-38
Gender Female, 54.5%
Disgusted 45.3%
Calm 52.4%
Confused 45.4%
Sad 45.6%
Surprised 45.5%
Angry 45.5%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Female, 55%
Confused 46%
Surprised 46.2%
Happy 46.3%
Angry 45.4%
Sad 45.7%
Disgusted 45.3%
Calm 50.2%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Happy 47.1%
Disgusted 46%
Angry 45.4%
Surprised 45.6%
Sad 46.6%
Calm 49%
Confused 45.3%

AWS Rekognition

Age 16-27
Gender Female, 54.6%
Confused 45.5%
Sad 45.5%
Calm 46.6%
Happy 45.1%
Surprised 45.3%
Disgusted 45.2%
Angry 51.8%

AWS Rekognition

Age 16-27
Gender Male, 51.3%
Disgusted 48%
Sad 46.1%
Happy 46%
Surprised 45.5%
Calm 48.4%
Angry 45.5%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Confused 47.1%
Surprised 46.8%
Happy 45.7%
Calm 45.9%
Sad 48.9%
Disgusted 45.3%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 51.2%
Confused 45.3%
Angry 47.3%
Sad 46.1%
Calm 48%
Disgusted 47%
Happy 45.8%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Female, 51.3%
Confused 46.1%
Surprised 46%
Calm 48.1%
Sad 47.6%
Happy 45.4%
Disgusted 45.3%
Angry 46.5%

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a group of people posing for a photo 78.9%
a group of people posing for the camera 78.8%
an old photo of a group of people posing for the camera 74.6%