Human Generated Data

Title

Untitled (class portrait of a Catholic girl's school)

Date

19th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.12

Human Generated Data

Title

Untitled (class portrait of a Catholic girl's school)

People

Artist: Unidentified Artist,

Date

19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.12

Machine Generated Data

Tags

Amazon
created on 2019-07-19

Monitor 99.9
Display 99.9
Screen 99.9
Electronics 99.9
Television 98
TV 98
Person 97.4
Human 97.4
Person 97.2
Painting 97
Art 97
Person 94.7
Person 93.5
Person 92.7
Person 90.9
Person 78.5
Person 77.5
Person 76.7
Person 71.9
Person 62.6
Person 51.8
Person 41.7

Clarifai
created on 2019-07-19

picture frame 98.2
desktop 97.9
design 96.5
blank 96.5
empty 95.6
display 95.3
margin 93.4
old 92.6
texture 92.1
abstract 91.3
number 91
vintage 90.3
panel 89.6
symbol 88.8
retro 88.1
art 86.8
square 83.7
pattern 83.6
illustration 83.4
graphic 83.1

Imagga
created on 2019-07-19

tray 100
receptacle 86.2
container 66.6
television 30.7
buckle 29.6
fastener 23.7
black 19.8
symbol 19.5
old 19.5
technology 19.3
retro 18.8
restraint 17.8
sign 17.3
icon 15.8
vintage 14.9
device 14.7
business 14.6
blackboard 14.5
design 14.1
antique 13.8
grunge 13.6
computer 13.6
screen 13.5
button 13.2
close 13.1
web 12.7
frame 12.6
electronic 12.1
object 11.7
3d 11.6
electric 11.2
display 11.2
blank 11.1
glass 10.9
space 10.9
light 10.7
broadcasting 10.2
communication 10.1
power 10.1
telecommunication system 9.5
media 9.5
art 9.2
modern 9.1
monitor 8.9
set 8.5
texture 8.3
car 8.3
reflection 8.2
style 8.2
dirty 8.1
telecommunication 8.1
wall 8.1
information 8
tuner 7.9
nobody 7.8
round 7.8
press 7.7
video 7.7
control 7.6
grungy 7.6
key 7.5
window 7.3
earth 7.3
graphic 7.3
decoration 7.2
border 7.2
board 7.2
transportation 7.2
mirror 7.1
world 7.1
silver 7.1
travel 7

Google
created on 2019-07-19

Microsoft
created on 2019-07-19

person 81.1
clothing 68.6
picture frame 64.6
old 60

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Female, 99.4%
Disgusted 0.6%
Angry 1.2%
Confused 0.5%
Happy 1%
Calm 12.7%
Sad 83.7%
Surprised 0.3%

AWS Rekognition

Age 26-43
Gender Female, 50.8%
Surprised 45.2%
Calm 47.9%
Sad 49.3%
Happy 45.2%
Angry 45.9%
Disgusted 46%
Confused 45.4%

AWS Rekognition

Age 12-22
Gender Female, 99.3%
Sad 17.5%
Confused 5.6%
Happy 12.9%
Angry 4.6%
Calm 40.6%
Surprised 6.6%
Disgusted 12.4%

AWS Rekognition

Age 19-36
Gender Female, 98.7%
Disgusted 0.8%
Confused 1.3%
Happy 6.6%
Sad 36.9%
Angry 2%
Surprised 1.1%
Calm 51.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Sad 51.1%
Confused 45.3%
Angry 45.4%
Calm 46.1%
Happy 46.6%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Sad 54.1%
Disgusted 45%
Calm 45.6%
Confused 45%
Happy 45.1%
Surprised 45%
Angry 45.2%

AWS Rekognition

Age 23-38
Gender Female, 51.2%
Happy 45.4%
Sad 45.6%
Disgusted 45.1%
Surprised 45.1%
Angry 51.3%
Confused 45.1%
Calm 47.4%

AWS Rekognition

Age 45-63
Gender Female, 89.3%
Happy 1.6%
Disgusted 46.6%
Confused 0.9%
Calm 1.4%
Surprised 0.6%
Sad 37.5%
Angry 11.2%

AWS Rekognition

Age 26-43
Gender Female, 52.4%
Sad 50%
Surprised 45.2%
Angry 45.6%
Disgusted 45.2%
Calm 47.9%
Happy 45.6%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Sad 55%
Angry 45%
Calm 45%
Surprised 45%
Happy 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Male, 50.7%
Confused 45.7%
Calm 47%
Sad 48.2%
Disgusted 45.9%
Surprised 45.7%
Happy 45.8%
Angry 46.6%

AWS Rekognition

Age 9-14
Gender Female, 54.9%
Calm 45%
Happy 45.2%
Disgusted 45%
Confused 45%
Angry 53.1%
Sad 46.5%
Surprised 45%

AWS Rekognition

Age 15-25
Gender Male, 62.9%
Sad 13.9%
Confused 1.5%
Disgusted 2.1%
Happy 5.4%
Surprised 3.3%
Angry 3.3%
Calm 70.5%

AWS Rekognition

Age 16-27
Gender Female, 51.5%
Happy 45.2%
Sad 50.2%
Disgusted 45.1%
Calm 46.8%
Angry 47.5%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Female, 96.7%
Happy 1.9%
Disgusted 0.2%
Angry 3%
Surprised 0.3%
Sad 92.7%
Confused 0.3%
Calm 1.7%

AWS Rekognition

Age 4-9
Gender Female, 53.9%
Disgusted 45.5%
Confused 45.2%
Angry 46.5%
Sad 51.9%
Happy 45.2%
Surprised 45.2%
Calm 45.6%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Angry 45.5%
Sad 52.4%
Calm 46.5%
Disgusted 45.1%
Surprised 45.1%
Happy 45.2%
Confused 45.2%

AWS Rekognition

Age 30-47
Gender Female, 54.2%
Surprised 45.1%
Happy 46.1%
Calm 46.6%
Confused 45.1%
Angry 50%
Sad 47%
Disgusted 45.1%

AWS Rekognition

Age 29-45
Gender Male, 53.2%
Happy 45.1%
Sad 45.9%
Disgusted 45%
Surprised 45.1%
Angry 45.7%
Confused 45.1%
Calm 53.1%

AWS Rekognition

Age 20-38
Gender Female, 99.4%
Happy 2.6%
Disgusted 1%
Angry 2.4%
Sad 20.5%
Confused 3.3%
Calm 68.9%
Surprised 1.4%

AWS Rekognition

Age 11-18
Gender Female, 53.2%
Surprised 45.2%
Sad 50.7%
Calm 46.1%
Angry 46.6%
Confused 45.2%
Disgusted 45.2%
Happy 45.9%

AWS Rekognition

Age 15-25
Gender Female, 54.1%
Happy 45.9%
Angry 45.3%
Disgusted 45.1%
Sad 52.9%
Confused 45.1%
Calm 45.5%
Surprised 45.1%

AWS Rekognition

Age 27-44
Gender Female, 51%
Disgusted 45.3%
Happy 45.6%
Calm 46.3%
Confused 45.2%
Sad 52.2%
Surprised 45.1%
Angry 45.4%

AWS Rekognition

Age 11-18
Gender Male, 54.2%
Sad 54.7%
Confused 45%
Happy 45%
Angry 45.1%
Calm 45.1%
Surprised 45%
Disgusted 45%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Painting 97%

Categories

Captions

Azure OpenAI

Created on 2024-01-27

The image shows an old, monochromatic photograph with a gold and black decorative frame. It appears to be a group portrait of multiple individuals in attire that suggests the photograph is from an earlier era, with styles typical of the 19th or early 20th century. The individuals are arranged neatly in rows, and they seem to be in an outdoor setting. The photograph has a vintage look, with some fading and discoloration that is common in aged pictures.

Anthropic Claude

Created on 2024-03-29

The image shows a large group photograph of a number of women and girls, likely from the 19th century based on their dress and style. The individuals are seated or standing in rows, all wearing bonnets, shawls, and other period clothing. The image has a vintage, sepia-toned quality and is framed within an ornate, gilded border. While the faces of the individuals are visible, I will refrain from identifying or naming any of the people shown, in accordance with the instructions provided.