Human Generated Data

Title

Untitled (older couple and boy in living room in front of windows)

Date

c. 1940

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12525

Human Generated Data

Title

Untitled (older couple and boy in living room in front of windows)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 98.4
Human 98.4
Clothing 97.4
Apparel 97.4
Person 96.4
Person 95.2
Accessories 93.9
Tie 93.9
Accessory 93.9
Furniture 82.7
Nature 81.3
Female 77.8
Fashion 71.2
Gown 71.2
Outdoors 70.4
Curtain 69.3
Robe 65.2
Text 62.9
Woman 62.4
Face 62
People 61.5
Bed 55.3

Imagga
created on 2022-01-29

shower curtain 100
curtain 100
blind 80.8
furnishing 80.7
protective covering 54.5
ice 32
covering 29
cold 27.5
snow 25.7
grunge 24.7
winter 23
texture 22.2
water 20.7
cool 19.5
frozen 19.1
pattern 18.5
frost 17.3
drop 15.4
art 15
season 14.8
glass 14.5
transparent 14.3
weather 14.3
clear 13.9
splash 13.9
dirty 13.6
wallpaper 13
design 12.9
natural 12.7
material 12.5
forest 12.2
backgrounds 12.2
drawing 12.1
wall 12
crystal 11.7
splashing 11.6
park 11.5
creative 11.5
rain 11.3
artistic 11.3
sketch 11.3
paint 10.9
close 10.8
vintage 10.8
surface 10.6
color 10.6
fresh 10.5
old 10.4
liquid 10.4
bubble 10.4
outdoor 9.9
wet 9.8
snowy 9.7
black 9.6
decoration 9.6
solid 9.3
tree 9.2
clean 9.2
drink 9.2
speed 9.2
frame 9.2
aged 9
environment 9
border 9
icy 8.8
country 8.8
seasonal 8.8
antique 8.7
motion 8.6
grungy 8.5
poster 8.5
flowing 8.4
peaceful 8.2
landscape 8.2
graphic 8
light 8
textured 7.9
frosty 7.8
people 7.8
space 7.8
falling 7.7
structure 7.7
stream 7.6
drops 7.5
decorative 7.5
freshness 7.5
sport 7.4
flow 7.4
purity 7.4
retro 7.4
detail 7.2
painting 7.2
trees 7.1
rural 7
sky 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Sad 86.4%
Calm 6.7%
Angry 2.2%
Happy 2%
Disgusted 1.1%
Confused 0.7%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 52-60
Gender Male, 99.3%
Surprised 72.3%
Fear 13.6%
Confused 4.6%
Sad 4.1%
Calm 1.8%
Happy 1.6%
Angry 1%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Tie 93.9%

Captions

Microsoft

a group of people standing next to a window 38.1%
a group of people standing in front of a window 35.2%
a group of people standing in a room 35.1%

Text analysis

Amazon

17
5
7
HXA 17 7 5 5
F22H
HE
HXA

Google

4 5 5
4
5