Human Generated Data

Title

"The Father's Congratulations" (21)
Date

c. 1917-c. 1922
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.130

Human Generated Data

Title

"The Father's Congratulations" (21)

People

Artist: Unidentified Artist,

Date

c. 1917-c. 1922

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.130

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.9
Apparel 99.9
Human 97.8
Robe 96.4
Fashion 96.4
Person 96.2
Gown 95.8
Person 95.5
Wedding 93.4
Bride 89.2
Wedding Gown 89.2
Person 87
Plant 81.4
Person 77.9
Painting 72.2
Art 72.2
Bridegroom 69.7
Female 69.1
Person 62
Flower 60.1
Blossom 60.1
Drawing 57.8

Clarifai
created on 2023-10-26

people 99.4
woman 98.9
adult 98.2
art 97.9
illustration 97.5
print 97.5
group 95.1
wear 94.6
painting 94.5
dress 93.2
man 91.9
two 91.7
veil 90.1
portrait 87.9
wedding 86
one 84.9
religion 81.2
leader 78
bride 76.8
gown 75.6

Imagga
created on 2022-01-22

structure 43.6
fountain 39.3
gravestone 29
memorial 25.7
stone 22.4
water 20.7
grunge 20.4
old 16
river 16
art 15.8
waterfall 14.6
landscape 14.1
dirty 13.5
space 12.4
stream 12.3
tree 11.9
pattern 11.6
vintage 11.6
texture 11.1
close 10.8
frame 10.8
design 10.7
decoration 10.7
color 10.6
screen 10.6
snow 10.2
paper 10.2
flow 10.2
park 9.9
forest 9.6
splash 9
black 9
retro 9
summer 9
wet 8.9
digital 8.9
natural 8.7
rock 8.7
antique 8.6
cold 8.6
damaged 8.6
winter 8.5
rocks 8.5
flowing 8.4
outdoor 8.4
environment 8.2
container 8.2
graffito 8.2
fall 8.1
border 8.1
light 8
falls 7.8
artistic 7.8
scene 7.8
ice 7.6
grungy 7.6
background 7.6
fresh 7.2
night 7.1
travel 7
season 7

Google
created on 2022-01-22

Clothing 98.7
Plant 95
Dress 90.5
Human body 88.5
Tree 88.4
Organism 85.3
Art 85
Wood 83.7
Door 83.1
Adaptation 79.2
Poster 78.8
Trunk 77.9
Painting 77.4
Font 77
Vintage clothing 75.9
Suit 75.3
Forest 69.7
Illustration 68.2
Visual arts 68.2
Arch 68

Microsoft
created on 2022-01-22

text 99.5
painting 95.9
drawing 95.7
indoor 86.6
illustration 85.7
sketch 85.1
cartoon 51.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 98.5%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 93.9%
Sad 50%
Calm 47.4%
Confused 0.8%
Fear 0.6%
Disgusted 0.4%
Angry 0.3%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 18-24
Gender Female, 89%
Calm 93.1%
Sad 4.5%
Disgusted 0.8%
Confused 0.7%
Angry 0.4%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 89.4%
Disgusted 80.2%
Calm 11.7%
Angry 5.4%
Sad 1%
Confused 0.6%
Surprised 0.5%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.8%
Calm 93.9%
Sad 2.8%
Confused 0.8%
Happy 0.6%
Angry 0.6%
Fear 0.5%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 87.3%
Sad 11.1%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Female, 59.3%
Calm 99.1%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 18-24
Gender Female, 99.1%
Calm 72.3%
Happy 20.9%
Sad 2.6%
Angry 1.1%
Confused 0.9%
Surprised 0.8%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 27-37
Gender Male, 97.1%
Calm 91.4%
Sad 4.5%
Confused 2%
Angry 0.6%
Surprised 0.5%
Happy 0.5%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.2%
Calm 49.3%
Sad 15.3%
Confused 14.7%
Disgusted 10.4%
Surprised 4.1%
Angry 3.6%
Fear 1.4%
Happy 1.2%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 91.1%
Surprised 2.4%
Confused 1.9%
Disgusted 1.8%
Angry 1.4%
Happy 0.6%
Sad 0.5%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%
Painting 72.2%

Categories

Imagga

paintings art 98.6%

Captions

Microsoft
created on 2022-01-22

a screen shot of a book 30.5%

Text analysis

Amazon

21.
The
Father's
21. The Father's Congratulations.
Congratulations.

Google

The
Father's
21. The Father's Congratulations.
21.
Congratulations.