Human Generated Data

Title

Untitled (class picture on school steps, East Derry, New Hampshire)
Date

1951, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.386

Human Generated Data

Title

Untitled (class picture on school steps, East Derry, New Hampshire)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.386

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99.3
Person 99.2
Person 97.8
Clothing 96.7
Apparel 96.7
People 94.6
Porch 93.1
Person 89.1
Building 79.1
Housing 79.1
Family 77
Person 73.9
Person 63.6
Person 61.8
Door 61.5
Shoe 60.9
Footwear 60.9
Person 60.8
Shoe 58.6
Shoe 58.5
Flooring 58.4

Clarifai
created on 2023-10-25

people 99.9
child 99.8
group 99.6
son 99.1
group together 99
family 98.3
administration 97.9
monochrome 97.9
boy 97
portrait 96.9
sibling 96.9
home 95.4
offspring 95.1
girl 94.5
man 94.2
four 94
woman 92.4
adult 90.8
three 90.7
street 89.3

Imagga
created on 2022-01-08

kin 100
man 28.9
people 23.4
male 22.1
person 18.6
family 17.8
happy 16.9
portrait 16.8
couple 15.7
adult 15.1
room 15
child 14.1
happiness 14.1
outdoors 13.4
boy 13
classroom 11.9
youth 11.9
smiling 11.6
fun 11.2
men 11.2
lifestyle 10.8
love 10.2
black 10.2
two 10.2
dress 9.9
outdoor 9.9
holding 9.9
mother 9.7
together 9.6
musical instrument 9.6
home 9.6
sport 9.2
street 9.2
girls 9.1
park 9
summer 9
to 8.8
daughter 8.8
women 8.7
standing 8.7
bride 8.6
day 8.6
play 8.6
smile 8.5
business 8.5
fashion 8.3
human 8.2
playing 8.2
active 8.1
nurse 8
handsome 8
wind instrument 7.8
attractive 7.7
joy 7.5
city 7.5
leisure 7.5
world 7.4
wedding 7.4
new 7.3
group 7.2
holiday 7.2
romantic 7.1
interior 7.1

Google
created on 2022-01-08

Photograph 94.1
Smile 90.9
Window 90.9
Standing 86.4
Plant 86.2
Dress 86
Style 83.9
Building 83.7
House 81.5
Vintage clothing 77.4
Child 77.1
Monochrome 74.4
Porch 74.3
Snapshot 74.3
Monochrome photography 72.9
Event 70.9
Family reunion 68.3
Cottage 67
Team 66.7
History 66

Microsoft
created on 2022-01-08

outdoor 98.8
person 98.1
clothing 97.2
posing 95.9
house 85.5
smile 85.5
group 84.4
toddler 83.6
white 79.2
child 75.1
girl 70.1
black 68.4
boy 67.2
text 66.4
footwear 66.4
human face 65.8
woman 63.1
baby 56.5
old 45.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 9-17
Gender Male, 100%
Calm 52.1%
Confused 25.7%
Sad 8.3%
Happy 5.8%
Angry 4.1%
Disgusted 2.4%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 6-16
Gender Male, 100%
Calm 37.6%
Sad 26.3%
Confused 16.7%
Angry 9.5%
Surprised 3.6%
Fear 3.1%
Happy 2.3%
Disgusted 0.8%

AWS Rekognition

Age 6-12
Gender Female, 100%
Happy 99.8%
Sad 0.1%
Fear 0%
Surprised 0%
Calm 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 19-27
Gender Female, 98.5%
Calm 100%
Sad 0%
Confused 0%
Surprised 0%
Happy 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 85.8%
Angry 9%
Surprised 1.5%
Fear 1.1%
Confused 0.9%
Sad 0.8%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 89.7%
Calm 76.6%
Angry 21.1%
Confused 1.4%
Sad 0.6%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.6%
Sad 99.2%
Fear 0.5%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Calm 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 97.1%
Calm 0.6%
Angry 0.6%
Sad 0.5%
Disgusted 0.4%
Fear 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 13-21
Gender Male, 98.1%
Calm 64%
Confused 28.2%
Angry 2.4%
Sad 1.9%
Disgusted 1.1%
Surprised 1%
Fear 0.9%
Happy 0.4%

AWS Rekognition

Age 11-19
Gender Male, 92.2%
Calm 79.4%
Sad 11%
Happy 5.8%
Angry 1.6%
Confused 0.9%
Surprised 0.5%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 71.4%
Angry 13.7%
Confused 4.5%
Disgusted 4.3%
Surprised 3.5%
Sad 1%
Calm 0.9%
Fear 0.7%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 81.3%
Sad 17.3%
Angry 0.6%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.7%
Calm 83.7%
Sad 10.1%
Confused 3.4%
Angry 1.1%
Fear 0.6%
Surprised 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 9-17
Gender Female, 100%
Calm 77.2%
Confused 6.6%
Happy 5.3%
Surprised 5.1%
Angry 2.2%
Sad 1.8%
Disgusted 1.2%
Fear 0.6%

AWS Rekognition

Age 6-14
Gender Male, 96.3%
Calm 92.1%
Happy 2%
Confused 2%
Sad 1.5%
Angry 0.9%
Disgusted 0.8%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Female, 92%
Sad 56.8%
Calm 25.5%
Angry 9.6%
Confused 2.4%
Fear 2.2%
Surprised 1.5%
Disgusted 1.4%
Happy 0.6%

AWS Rekognition

Age 47-53
Gender Female, 100%
Calm 96.3%
Confused 1.5%
Sad 0.8%
Disgusted 0.7%
Surprised 0.4%
Happy 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Female, 100%
Fear 31.8%
Calm 26.5%
Surprised 19.5%
Confused 14%
Disgusted 3.1%
Angry 2.1%
Sad 1.9%
Happy 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 60.9%

Text analysis

Amazon

TEACHER
ACADEMY
ADAMS
1825
FEMALE
BY
1824-1828
IN
VISITED BY
LYON
VISITED
MARY LYON
LAFAYETTE
MARY

Google

ADAMS FEMALE ACADEMY MARY LYON TEACHER 1824-1828 VISITED BY LAFAYETTE IN 1825
ADAMS
FEMALE
ACADEMY
MARY
LYON
TEACHER
1824-1828
VISITED
BY
LAFAYETTE
IN
1825