Human Generated Data

Title

View of Rocks. Rocky Point, RI

Date

c 1875

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3798

Human Generated Data

Title

View of Rocks. Rocky Point, RI

People

Artist: Unidentified Artist,

Date

c 1875

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3798

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 99.1
Poster 98
Advertisement 98
Person 94.6
Person 94.6
Tree 85.7
Plant 85.7
Outdoors 82.2
Nature 79.9
Collage 74.1
Vegetation 71.3
People 68.1
Clothing 67.3
Apparel 67.3
Art 64.6
Person 64.6
Photography 61
Photo 61
Land 60.4
Soil 59.4
Face 59.2
Female 58.1
Text 58.1
Housing 56.5
Building 56.5

Clarifai
created on 2023-10-26

people 99.6
group 98.7
tree 98.5
art 96.6
adult 95.4
wear 95.2
print 93.6
landscape 93.5
two 92.6
man 92.6
painting 92.4
woman 92.2
vintage 90.1
one 86
child 84.7
old 84.1
wood 84
three 82.1
interaction 81.4
retro 80.2

Imagga
created on 2022-01-22

tree 54.2
forest 35.9
landscape 35
snow 31.2
winter 30.6
trees 27.6
cold 25
season 23.4
park 22.2
scenery 19.8
autumn 19.3
sky 18.1
old 16.7
scene 16.4
woody plant 16
wood 15.8
scenic 15.8
fence 15.6
snowy 15.6
fog 15.4
grunge 15.3
mountain 15.2
countryside 14.6
fall 14.5
weather 14.4
sapling 14.4
structure 13.8
woods 13.4
light 13.4
outdoor 13
frost 12.5
leaf 12.5
vintage 12.4
vascular plant 12.2
ice 12
travel 12
outdoors 11.9
branch 11.9
mist 11.6
pine 11.6
country 11.5
rural 11.5
wall 11.3
barrier 11.2
frosty 10.8
environment 10.7
grass 10.3
frame 10.1
dark 10
morning 9.9
road 9.9
retro 9.8
freeze 9.7
black 9.6
antique 9.5
ancient 9.5
empty 9.4
natural 9.4
texture 9
plant 9
river 9
sun 9
foggy 8.9
wilderness 8.8
land 8.8
frozen 8.6
clouds 8.5
aged 8.1
new 8.1
brown 8.1
yellow 8
textured 7.9
misty 7.9
day 7.8
art 7.8
sand 7.8
torn 7.7
panorama 7.6
weathered 7.6
path 7.6
rain 7.5
field 7.5
rough 7.4
mountains 7.4
obstruction 7.3
water 7.3
ecology 7.3
peaceful 7.3
shovel 7.2
recreation 7.2
paper 7.1
leaves 7

Google
created on 2022-01-22

Tree 88.6
Branch 87.2
Yellow 86.2
Plant 83.6
Art 80.1
Adaptation 79.3
Tints and shades 77.4
Visual arts 66.7
History 65.8
Room 64.6
Paper product 64.1
Vintage clothing 63.6
Stock photography 63.5
Landscape 61.7
Slope 59.3
Font 59.3
Photographic paper 58.3
Wood 56.2

Microsoft
created on 2022-01-22

tree 100
text 100
sign 94.7
outdoor 92.1
person 76.3
clothing 75.5
image 36.5
picture frame 34.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 2-8
Gender Female, 70.7%
Happy 53.2%
Calm 19.8%
Surprised 17.7%
Fear 3.1%
Confused 1.9%
Disgusted 1.7%
Angry 1.6%
Sad 1%

AWS Rekognition

Age 24-34
Gender Female, 98.3%
Happy 91%
Surprised 4.5%
Calm 1.5%
Fear 1.4%
Angry 0.6%
Disgusted 0.4%
Sad 0.4%
Confused 0.3%

AWS Rekognition

Age 18-24
Gender Female, 75.5%
Calm 61.9%
Happy 28.3%
Confused 3.2%
Surprised 1.7%
Sad 1.4%
Angry 1.3%
Fear 1.1%
Disgusted 0.9%

AWS Rekognition

Age 6-14
Gender Female, 81.1%
Calm 94.3%
Happy 3.1%
Confused 1.1%
Surprised 0.5%
Disgusted 0.4%
Fear 0.4%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 10-18
Gender Female, 55.7%
Happy 98.3%
Calm 1%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 7-17
Gender Female, 52.4%
Happy 65.4%
Calm 33.7%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 97.4%
Calm 90.7%
Happy 4%
Sad 2.9%
Disgusted 0.8%
Angry 0.6%
Surprised 0.4%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 16-24
Gender Male, 75.3%
Calm 84.6%
Fear 11.9%
Sad 1.7%
Surprised 0.5%
Disgusted 0.5%
Happy 0.3%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 98.1%
Calm 96.3%
Sad 1.1%
Angry 1.1%
Happy 0.7%
Fear 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person 99.4%
Poster 98%

Categories

Imagga

interior objects 74.8%
paintings art 14.2%
food drinks 7.8%

Captions

Microsoft
created on 2022-01-22

an old photo of a sign 90.5%
a sign in front of a book 71.3%
a sign for a photo 71.2%